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Preface 


Since graduate school days I have been interested in understanding com- 
plex human behavior as it is learned. This interest has led me to examine 
articles in a large number of different journals, to theoretical and lab- 
oratory research with child and adult subjects,and to the development of 
courses in complex human learning. In this study it has appeared to me that 
a feasible strategy was to employ as the basic theory an integration of em- 
pirical principles, cutting across various theoretical orientations. With such 
a theory it seemed possible to handle a good deal of naturalistic and lab- 
oratory evidence concerned with human activities. (The formulation which 
has resulted from this study has been set forth by me, with the help of my 
wife, Carolyn Staats, in the book called Complex Human Behavior. ) 

The articles which I have selected for presentation herein fit this general 
scheme. They have been chosen to be extensions of empirical conditioning 
principles which are acceptable regardless of theoretical learning position. 
I have attempted to avoid enmeshment in theoretical controversies. Al- 
though some articles employ theoretical terms, such as implicit responses, 
they are with few exceptions of a response or stimulus nature and still in- 
volve the extension of empirical conditioning principles. 

The present book will introduce an approach to the field of human learn- 
ing, based upon what I see as a shift of interest that is more and more 
becoming evident. The systematic experimental study of the principles by 
which environmental events shape behavior began largely with animal sub- 
jects. The studies which were conducted using human subjects tended to 
be analogous to the animal studies in their attempt to establish basic ana- 
lytical principles. As such they tended to be rather widely removed from 
significant problems of human behavior. 

However, unobtrusively, a number of studies have been emerging that 
demonstrate the shift from the use of human subjects for the study of 
learning principles per se to the use of basic learning principles and meth- 
ods in the study of human behavior. Investigators working within this 
general framework have developed experimental techniques and procedures 
with which to study various areas of significant human behaviors, and have 
produced a body of findings which has not yet been organized and pub- 
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lished in book form. The products of this area of investigation appear to 
have importance for every field concerned with environmental influences 
on the acquisition and maintenance of behavior in humans. 

The present book attempts to fill the gap in the textbook coverage of 
this significant advance. Because of this purpose I have not included studies 
in human learning which do not have well-developed extensions to com- 
plex human behavior. Thus, for example, traditional studies in paired-asso- 
ciate and serial verbal learning have not been sampled except as they are 
relevant to complex behaviors, for example, thinking and problem solving. 

There are additional purposes involved in bringing these representative 
articles from the described area of study together in one book. The indi- 
vidual articles when viewed in isolation merely represent interesting dem- 
onstrations of learning in a new context of human behavior. Together, 
however, the various articles form a powerful conception of large aspects 
of human behavior. It is frequently said in various behavioral sciences that 
human behavior is acquired (learned), not laid down in biological struc- 
ture. To the extent that this is true, a conception of human behavior based 
upon empirical learning principles would constitute a basic science for the 
behavioral sciences. 

Thus, the present book is a reflection of the development in the applica- 
tion of learning principles to the study of human behavior and its problems. 
It is hoped, also, however, that it will focus this development and provide 
a stimulus as well. In this there are several dominant themes. First, the 
various studies suggest that an integration of empirical learning prin- 
ciples and methods will serve as a general approach to the study of human 
behavior and its problems. Second, information on contemporary research 
procedures for this study are described in the articles. These methods con- 
stitute an important set of tools for the empirically minded student of 
human behavior, and with the content of the articles will suggest further 
advancements. In addition, the set of articles provide support for the view 
that learning psychology is entering upon the phase of a science where basic 
principles and methods become applicable to the study and solution of 
complex problems. And, last, as is explicitly stated in one selection and 
shown by example in the others, the application of basic principles in a 
science to more complex cases and to actual practical problems is an in- 
tegral part of the generalization and verification of the principles and the 
science. I hope the articles to be presented will encourage empirically 
oriented students of psychology that this type of extension of learning prin- 
ciples is becoming a major path in the advancement of their science. 

Because the present group of readings is based upon a set of principles, 
it presents the possibility of being more integrated than most books of read- 
ings. The editor has attempted to enhance this quality in selecting the 
articles and in organizing them both within and between the various parts 
of the book—although this does not follow simple rules, and does not 
hold in all cases. Within each of the eight areas there is an attempt, where 
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possible, to begin first with articles which present principles upon which 
the later articles will be based. In addition, to some extent the order of 
the areas was arranged in the same manner, 

The introduction which I have composed for each area also aims to or- 
ganize the studies with respect to one another so that the readings will be 
more likely to yield an integrated understanding. In addition, however, the 
introductory sections attempt to abstract important points which will help 
in understanding the article, and at times introductions will to some degree 
include interpretations as part of the task of fitting an article into a con- 
sistent set of learning principles. 

In terms of the use of the book as the text in a course, I have assumed 
the student will have an introduction to the basic principles of operant 
and respondent conditioning. With such a background the book could 
serve as the text in second courses in learning or in courses in human learn- 
ing. In other courses the book could serve as a text where it was supple- 
mented by an accompanying text or set of lectures which presented the 
basic principles. Courses in general psychology might fall into this cate- 
gory. In addition, however, the book may be used as a supplement in 
various fields of general psychology concerned with human behavior where 
the effects of environmental events are important, for example, child 
psychology, social psychology, or personality. The book is especially relevant 
to child psychology courses. Almost half of the articles deal with children, 
and most of the others involve material important in child learning. And, 
from a learning orientation, all of the articles deal with the study of per- 
sonality, since this field is concerned with the acquisition and function of 
complex human behavior. Instructors of social psychology courses interested 
in environmental effects on human behavior should also find most of the 
articles to be relevant to their field. 

The book is also intended for graduate students of educational psychol- 
ogy who have a primary concern with the applications of learning prin- 
ciples to learning problems in children and adults. The need of such 
students for a background in human learning principles, methods, and 
contemporary findings is made more crucial by the recent developments in 
the application of learning approaches to educational problems. As is the 
case for the other courses also, there is no text at the present time in the 
field of educational psychology which presents the material introduced in 
the present book. 

I would like now to acknowledge the scientific and scholarly acumen of 
the authors who have contributed articles as well as their kindness in giving 
reproduction permission. Appreciation is also due the editors and pub- 
lishers for the original presentation of the articles as well as for giving re- 
production permission. Each selection will have a specific permission 
citation. 

In the work which has led to the formulation underlying the selection 
of this set of readings as well as to some of my own articles which this book 
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includes, there are a number of people to whom I would like now to ex- 
press appreciation. I would like first to express my gratitude to Carolyn 
Staats, not only for her help in various ways on a number of my projects, 
including reading proof for part of this book, and as an interested and en- 
couraging colleague, but also for her personal contributions as my wife and 
the mother of our children. Other colleagues have contributed to one or 
more studies; among them are Richard E. Schutz and Lloyd L. Brooks. 
And a number of individuals contributed as graduate students to my re- 
search; these include Donald Biggs, Hugh L. Crawford, Judson R. Finley, 
William G. Heard, Karl A. Minke, Larry P. Nims, and Montrose Wolf. 

Research and scholarly activity, however, also require support of a mate- 
rial kind. In addition to the support provided by Arizona State University 
through the efforts of Deans Arnold Tilden and Karl Dannenfeldt, De- 
partmental Chairmen Arthur J. Bachrach, and the late Hudson Jost, several 
governmental agencies have been very important to me. I owe special 
thanks to the Office of Naval Research and its representatives Glenn L. 
Bryan and D. D. Smith for their long-term help which is reflected in some 
of the articles included herein. In addition, the National Institute of 
Mental Health and the Office of Education have made contributions for 
which I am grateful. Recognition of the support of specific articles will be 
indicated at the bottom of the first page of the articles involved. 

The critical evaluation and suggestions contributed by Albert Bandura 
and Robert M. Gagne were very much appreciated. 

In addition, Judson R. Finley and Mrs. Jane Little assumed primary re- 
sponsibility for the preparation of the manuscript and to this task devoted 
more than the usual care—for which I am grateful. 


Arthur W. Staats 


Tempe, Arizona 
May 1964 
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chapter I 


Introduction 


A SOUND STRATEGY to approach the study of any new set of events, as ex- 
emplified in various sciences, is to deal with the more simple occurrences 
first, in order to establish basic principles. This is done when the study turns 
to the analytical procedures of the laboratory, where the attempt is made 
to simplify matters by manipulating a very few conditions (independent 
variables) to observe their effects upon some other condition (dependent 
variable). Complications are excluded by insuring that other conditions 
which would act as independent variables do not influence the outcome, 
even though in everyday life the various independent variables may act 
simultaneously, Thus, for example, if one wished to observe the effect of 
the number of paired presentations of a conditioned stimulus and an un- 
conditioned stimulus (the independent variable) upon the strength of 
conditioning (the dependent variable), he would have to keep the time be- 
tween the presentation of the CS and UCS constant. For time between 
CS and UCS also acts as an independent variable in affecting strength of 
conditioning. 

Later in a science, after the basic, analytic principles have been estab- 
lished by means of laboratory experimentation, more complex constella- 
tions of interacting variables may be considered. Ultimately, after the basic 
principles have been verified in more complex situations, the principles and 
procedures developed may be applied to the solution of important practical 
problems. 

This type of development appears to be taking place in the experimental 
study of the effect of environmental occurrences (independent variables ) 
on behavior (depedent variables). In life there are complex environmental 
variables acting on complex behaviors. To separate these relationships and 
discover the basic principles, the experimental psychology of learning 
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turned to laboratory simplification. This has meant that experimental learn- 
ing was long restricted largely to the study of simpler organisms, simple 
situations, and simple behaviors. 

From these investigations, however, has emerged a set of principles of 
learning which, although they are not entirely complete, nor without con- 
troversy, seem to form the basis of the type of development which has been 
described, That is, the later stages of the development of a set of scientific 
principles have commenced in this area of study. First, the basic principles 
and procedures have been extended to studies with the more complex or- 
ganism “man,” under conditions of laboratory control. Even when the 
behaviors are simple and the situation is simple, these studies constitute 
an important advance because they indicate that the principles apply to 
man and they begin to form a concept of man’s behavior. One or two of the 
studies to be presented herein are of this type. An example might be the 
test of principles of conditioning using children as subjects, such as Selec- 
tion 3 in Chapter II. 

A further advance in the science of human behavior is made when the 
basic principles are extended to more complex behaviors of man, or be- 
haviors which are more unique to man. This may involve more complex 
situations also. Many of the examples in the book are of this type of exten- 
sion, for example, the articles which approach the study of verbal behavior 
(see Chapters IT and III) in terms of conditioning principles. 

Lastly, when the behaviors involved in the study are of importance to 
human adjustment, then this represents actual application of basic 
principles to the solution of practical problems. Some of the studies to be 
presented are in this category and may also suggest how further advances 
may be made in applying learning principles to human problems. Thus, 
there are studies in which conditioning principles are utilized to improve 
training techniques in educational psychology (Chapter II), or where the 
principles are applied to the treatment of abnormal behavior (Chapter IX). 

This type of development, where basic laboratory established principles 
are extended to more complex cases, involves important considerations for a 
certain type of theory construction in psychology. To begin with, it may be 
said in general that when a scientific principle (for example, a relationship 
between independent and dependent variables) has been established under 
certain conditions, it constitutes a hypothesis when it is extended to a new 
set of conditions. If the principle is verified under the new conditions, the 
confidence in the principle is increased as well as the generality of the 
principle. 

When a related set of principles is being extended to a new area the set 
may be considered to be a conception or theory. Again, the principles must 
be corroborated in the new context for the theory to inspire much con- 
fidence. It has been indicated (Braithwaite, R. B., Scientific Explanation. 
Cambridge: Cambridge Univer. Press, 1955), however, that in apply- 
ing a related set of principles there are several types of verification. The in- 
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dividual principle involved may receive direct verification in an experiment. 
When this occurs, however, the experimental support applies not only to 
the specific principle involved, but also indirectly to the other related 
principles. 

The related set of basic principles of conditioning may be considered to 
be such a conception or theory when the set is extended to man’s behavior. 
Verification of the basic principles as a conception of man’s behavior 
comes when the principles are shown to function in that context. Thus, 
when one learning principle which was established with lower organisms is 
verified with human behavior, the principle may be said to receive support. 
In addition, however, the verification suggests also that other behaviors 
are learned and that other basic learning principles are also relevant to the 
behavior of man. 

The articles presented herein may be considered to be part of this type 
of scientific progress. Many experiments are described, each of which sup- 
ports the extension of one or more conditioning principles to an aspect of 
man’s behavior, and thereby indirectly supports the extendability of the 
whole set of principles to additional human behaviors. This is discussed 
here so that the reader may have in mind the general nature of the endeavor 
involved. In addition, the reader may then evaluate the extent to which the 
various articles give support to the set of conditioning principles as a sound 
theory for many of man’s behaviors. (In developing this rationale the 
author has also selected a set of learning principles that together seem 
capable of accounting for a great deal of human behavior. The reader is 
referred to Staats, A. W., and Staats, C. K., Complex Human Behavior. 
New York: Holt, Rinehart and Winston, 1963 for the more complete 
account of the rationale as well as the set of conditioning principles.) 

The following group of studies are only representative of those which 
extend the basic principles of conditioning to the study of human behavior. 
The studies are arranged into eight additional chapters: Child Learning; 
Verbal Behavior; Communication; Problem Solving; Attitude Learning and 
Human Motivation; Social Interaction, Attitude Function, Group Co- 
hesiveness, and Social Power; Personality; and Behavioral Treatment. Each 
chapter includes a number of experimental or theoretical articles. The eight 
sections were selected because they are important areas of study in complex 
human behavior, and because there is in each area a substantial group of 
studies which appear to have general significance for understanding man’s 
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Child Learning 


From a learning approach it would be expected that the child’s experience 
is most important to his later behavior. It is in the period of childhood that 
progress is made from an organism with a very limited repertoire of motor 
and verbal behaviors under poor environmental control to an organism who 
has extremely complicated verbal and motor behaviors under complex stim- 
ulus control—including subtle social controls. 

It has been assumed in many cases that this acquisition of behavior 
occurs on the basis of internal maturational processes. In fact, a great deal 
of the research in the area of child psychology has been from such an 
orientation. Interest in pursuing a learning approach to behavior, however, 
rests upon the conviction, and demonstration, that experiential events 
mold important aspects of the child’s behavior development, according to 
discoverable principles. This chapter, and most of those to follow, sample 
some of the studies which provide such a demonstration. To start with, 
the first article by Fowler presents a review of the literature which has dealt 
with the relative importance of learning (nurture) versus maturational 
(nature) variables, as well as some of the reasons why learning variables 
must be considered important to the development of some complex human 
behaviors. Fowler also points out that the past emphasis on the biological 
(maturational) approach has hindered advancements in understanding how 
the child learns. On the other hand, learning approaches have in the past 
been restricted largely to studies of simple behaviors, many times with 
simple organisms. Fowler also indicates areas in which research on child 
learning should be conducted and presents some recommendations con- 
cerning the need for long-term experimental study of complex child learn- 
ing which agrees with some of the later studies to be presented. 

Actually, although the learning versus maturation controversy may have, 
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in general, retarded the systematic study of complex learning in children, 
the extension of learning principles to the study of child behavior had an 
early beginning with the application of the principles of classical (or re- 
spondent) conditioning. The study by Watson and Rayner demonstrates 
the principles in the context of the acquisition of childhood fears. 

More recently, the experimental technology for the study of learning 
in children has undergone a rapid development. This development has 
largely been concerned with operant (instrumental) conditioning. Bijou 
and his associates have made significant contributions to this development 
and the next selection is chosen as an example. This article by Orlando and 
Bijou shows some of the advances which have been made in the technology 
of studying behavior principles in children. The response measure used is 
continuous and records responses automatically. Minute to minute changes 
in behavior as a function of independent variables can be reliably observed. 
This advance in technology allows sensitive study of the principles by which 
environmental variables control behavior. Like the preceding and the fol- 
lowing studies, the continuity from principles and procedures established 
with lower organisms to the behavior of humans is shown, and this con- 
tinuity will be further demonstrated in later articles within the context of 
complex behaviors significant to the child’s life adjustment. 

The study of Orlando and Bijou also indicates how special populations of 
children can be experimentally studied. Through these techniques the 
principles of behavior which are operative can be compared to those 
which function for normal children. And the principles appear to be the 
same, Later articles in this book will extend this suggestion. However, it 
is useful now to indicate another example of the types of children’s be- 
havior problems which can be studied by means of these principles and 
methods. The study by Baer suggests that the problem of thumbsucking 
may be approached from a consideration of reinforcement principles, as 
well as the more general point that experimental procedures may be 
adapted for working with problem behavior. 

The next article by Simmons and Lipsitt indicates how the first acquisi- 
tion of behavior by human infants may be experimentally studied by mak- 
ing the necessary adaptation of laboratory procedures. As the authors con- 
clude, the procedures outlined “offer a technique for the study of learning 
and discrimination processes in the human infant” and suggest that sen- 
sory capacities could be studied in nonverbal children using variations of 
method. It may be added that the procedures might also be adapted for 
the study of other important human behaviors, for example, the first 
language acquisition of children, the development of social reinforcers, 
and so on. 

Bandura (see Bandura, A., Social learning through imitation, Nebraska 
Symposium on Motivation (M. R. Jones, ed.). Lincoln: Nebraska Univer. 
Press, 1962) has indicated in various articles that he feels that in many 
cases consideration of human learning in terms of direct reinforcement of 
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behavior is too simple-minded. He suggests that observation of other 
people’s behavior and the consequences of that behavior (that is, reinforce- 
ment contingent on the behavior) can also affect the observer's behavior. 
The experiment included in this section by Bandura, Ross, and Ross is 
important in indicating how “imitative learning” effects can take place. 
(See Chapter 7 also.) Especially interesting is the fact that the child’s ex- 
perience is with film, not with people themselves. This has implications for 
considering the effects of mass communication on child learning. 

In addition to the effects of learning upon behavior, an important de- 
terminant of human behavior is to be found in “motivational” variables. 
Central to this topic is the assessment of stimuli which have a strengthen- 
ing, or reinforcing, effect when they follow behavior—as well as the condi- 
tions which determine the extent of this reinforcing effect. Some stimuli 
have this effect on an unlearned basis, but for man many of these stimuli 
are conditioned reinforcers of a social variety and only acquire their re- 
inforcing value through having been paired with other reinforcers. ‘The 
study of Gewirtz and Baer indicates that the same motivational principles 
found with lower organisms and unlearned reinforcers, also operate with 
children and social reinforcers in terms of determining the strength of the 
social reinforcer. Generalization of this result makes an important contri- 
bution to the understanding of human motivation (see Chapters 6 and 7). 


1. 
Cognitive Learning 
in Infancy and Early Childhood * 


William Fowler! 


* From W. Fowler, Cognitive learning in 
infancy and early childhood, Psychol. Bull., 
59, 116-152 (1962). Reprinted by per- 
mission of the author and the American 
Psychological Association. 


1 The writer is much indebted to Helen 
L. Koch for her critical reading of an earlier 
version of the manuscript. 


How early can a child learn complex 
cognitive operations? Can a preschool 
child make substantial progress with ver- 
bal symbols and other abstract concepts? 
If so, how soon and under what condi- 
tions? Strangely enough, these important 
questions scarcely have been asked in the 
psychological literature during the pres- 
ent century. Why? 

In this review we shall try to answer 
these and other related questions through 
a critical examination of representative 
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studies on cognitive learning in early 
childhood. Our object is to show how the 
neglect of certain key problems has con- 
tributed to psychology’s low estimate of 
the young child’s potential for cognitive 
learning. . . . 


Motor Development 


There have been two main types of 
studies of motor processes in children, 
other than those of the short-term 
learning variety. Both of these have been 
typically cast in the framework of matura- 
tional hypotheses. In one approach, pro- 
ducing the greater bulk of studies, work 
seldom has gone beyond defining and 
measuring a range of more or less simple 
motor skills, both gross (e.g., crawling or 
climbing) and fine (e.g, apprehending 
or releasing a pellet). Little attention 
has been paid to the influence of ex- 
perience on the development of these 
skills. It usually has been assumed that 
skills are acquired through “normal” 
processes of maturation, following a de- 
finite sequence of “stages” of motor de- 
velopment. Gesell and his followers at 
Yale (e.g., Gesell, Halverson, Thompson, 
Ilg, Castner, Ames, & Amatruda, 1940; 
Gesell & Ilg, 1949), Bayley (e.g, 1935), 
Shirley (e.g, 1931), and others have 
accumulated much data of this nature. 

The second type of motor investi- 
gation has been designed to determine 
the relative importance of maturation 
and learning in early development (cf. 
Gesell & Thompson, 1929; Hicks, 1930a, 
1930b; Hicks & Ralph, 1931; Hilgard, 
1932, 1933; McGraw, 1935, 1939; and 
others), The introduction of moderately 
long training periods, the teaching of 
relatively complex skills, and the use of 


control subjects are all found in this class 
of studies. In these studies an experi- 
mental group (or identical twin) usually 
has been trained for several weeks or 
more. Controls have then been given 
similar training, but often for shorter 
periods. Experimental and control chil- 
dren have been alternately kept in a nor- 
mal or deprived environment while the 
matched groups have undergone periods 
of training. In some cases (e.g, Hicks, 
1930a, 1930b) the control group was 
given no special training. 

Nearly all investigators have found 
some evidence that, while training in 
specific skills often improves perform- 
ance, the amount of learning has been 
greater when the training has been de- 
ferred until the children were at least 
a few weeks older. They have frequently 
concluded, therefore, that age (matura- 
tion) is a more vital agent than experi- 
ence in development. Many believe that 
training in skills of this type is more 
efficient as neural structures mature—up 
to a certain “optimum” age, which varies 
with complexity of skill. 

Often underplayed, however, is the fact 
that specific training has invariably pro- 
duced large gains, regardless of whether 
training came early or late in develop- 
ment. In addition, partly as a result of the 
maturational bias, there have frequently 
been methodological shortcomings. These 
have further lessened awareness of the 
influence of experience upon develop- 
ment. In the first place, most studies 
have dealt with simpler skills for which 
there is evidence of ability “ceilings” or 
physiological limits. For example, in Hil- 
gard’s (1932) experiment on teaching 
10 2-3 year old children buttoning, 
climbing, and cutting with scissors, the 
experimental children’s learning curve 
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tended to fall off toward the end of their 
12-week training program. Such a ceiling 
limits the relative advantage possible 
from longer training. Similarly, Shirley 
(1931) met limited success in trying to 
accelerate the speed of development in 
walking of her 25 infants. Again, are we 
not dealing with a skill tied closer to 
biology, as McGraw (1935) suggests, 
than is true for more complex skills and 
categories of knowledge? 

Interesting evidence on the importance 
training may have in developing complex 
skills is reported by Mattson (1933). She 
found, that in subjects ranging from 58 to 
72 months in age, training in a rather 
simple rolling-ball maze yielded little if 
any advantage to the trained group. With 
more complicated patterns, however, and 
as the patterns grew in complexity, the 
superiority of the trained group increased 
over that of the untrained. 

Another frequent error in experimen- 
tal design has probably produced an ad- 
vantage for the control children. Prior 
to their own training, and while the 
experimental children were undergoing 
training, the controls typically received a 
certain amount of experience in related 
motor activities as well as in cognition 
generally. Both of these types of ex- 
periences would be expected to facilitate 
the subsequent learning of the controls. 
Yet most investigators in their conclu- 
sions, while mentioning these related ex- 
periences, have been inclined to count 
gains accruing from this period as the 
work of maturation alone. It appears, 
then, that maturation and general experi- 
ence have been confounded. Moreover, 
given the stress in the American culture 
upon the value of sensory-motor experi- 
ence, this influence upon the develop- 
ment of the controls should not be mini- 
mized... . 


Language 


The language area provides still another 
study where Gesell’s twins were used. 
This study was also inspired by an em- 
phasis on maturational factors. Strayer 
(1930) stimulated Twin T verbally 
(word-object associations and simple corm- 
missions) from the ages of 84-88 weeks 
(inclusive), while Twin C was confined 
to a similar but language deprived en- 
vironment, Twin C was then given 4 
weeks of equivalent language stimulation, 
during which time Twin T experienced 
a normal speech environment. 

Over 4 weeks of their training pro- 
grams, C acquired a vocabulary of 30 
words and T learned 23. But the difference 
in rate of learning was slight, 1,074 to .936 
words per day, respectively, for their first 
29 words. Moreover, in total vocabulary 
(35 for T versus 30 for C), sentence 
structure and pronunciation, T was per- 
ceptibly superior to C, following T’s only 
slightly longer but earlier training. Twin 
T also appeared to be gaining in rate over 
C toward the close of the training. The 
really critical variable is contained in the 
additional 5 weeks of general cognitive 
(though largely nonlanguage) experi- 
ence, that C accumulated prior to begin- 
ning training. We must also reiterate our 
other criticisms of this kind of design, 
chiefly, (a) the fact that the major 
progress of both twins was obviously as- 
sociated with their specific training and 
(b) the significance of training was not 
demonstrated effectively because it was 
too brief. This second point would have 
been more dramatically illustrated, for 
example, had T’s training been continued 
for 6 months or more, while C was con- 
fined to a deprived or “average” language 
environment. 
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Dawe (1942) has contributed the only 
investigation using even relatively long- 
term language stimulation during the pre- 
schoo] years. She used older children 
ranging from 43 to 82 months in age. 
Dawe also studied other aspects of cogni- 
tive learning which will be reported 
further on. Coming from a deprived, 
orphanage environment, the subjects 
mean IO was only 80.6 at the outset. 
Using matched controls of 11 pairs of 
cl , Dawe gave the experimental 
group about 50 hours of training per 
child in language and general informa- 
tion concepts. Training consisted of view- 
ing and discussing pictures, listening to 
poems and stories, taking excursions, and 
making simple observations. On nearly 
all cognitive measures the improvement 
of the experimental group over their con- 
trols was significant at the 1% level. This 
included language measures of mean sen- 
tence length and the Smith-Williams 
vocabulary test. Indices of intelligibility 
and complexity of organization of speech 
also rose, but not significantly. Consider- 
ing that training was restricted largely to 
weekends and lasted only 3 months, com- 
pared to the children’s 4-7 years of total 
life experience, gains were indeed sizable. 
Additional designs of this type but em- 
bracing younger children from more 
normal backgrounds and over longer time 
spans should be carried out. 

A study by Milner (1951) offers prom- 
ising retrospective information on the 
value of early language experience. Tak- 
ing those first grade Negro children who 
scored contrastingly high and low on a 
language development test, she compared 
the two groups with respect to measures 
of their social background. The high 
language scorers were found to have 
participated much more widely in adult 


family conversation and received more 
overt demonstrations of affection, Other 
analyses of preschool children’s histories 
have also shown the importance of adult 
relations and other home variables for 
the development of children’s language 
(Smith, 1935; Van Alstyne, 1929; Wil- 
liams & Mattson, 1942). 

Beyond the foregoing studies, interest 
has centered on reporting age “norms” 
for acquiring various dimensions of 
language. It usually has been assumed 
that these norms directly reflect age- 
linked, maturational levels (cf. Chen & 
Irwin, 1946; Lewis, 1936; McCarthy, 
1930; Smith, 1926). But developmental 
norms can as readily be subject to en- 
vironmental as to an innate growth inter- 
pretation, although interpretations of the 
former kind are infrequent. To illustrate 
an environmental approach, Ames and 
Learned (1948) record that the biggest 
jump in the addition of new space con- 
cept words occurs between 2-2.5 years. 
Is it possible that cultural stimulation in 
these concepts typically increases around 
this age so as to produce this jump? If 
so, shouldn’t we ask whether cognitive 
development in this and other areas could 
not further be enhanced at all ages by the 
introduction of programed stimulation? ... 


Conceptual Processes and 
Intelligence (IQ) 


A heavy interest in the nature-nurture 
of intelligence (IQ) has been accom- 
panied by a massive accumulation of 
studies, however thin in definition the 
problem has remained. As these studies 
have been covered extensively in many 
reviews (Anastasi, 1958; Jones, 1954; 
Wellman, 1945; Wellman & McCandless, 
1946; Whipple, 1928, 1940; and others), 
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we shall concentrate principally on stud- 
ies and problems directly relevant to our 
purposes. 

The largest amount of work has con- 
sisted of cross-sectional studies of chil- 
dren and adults of all ages. In these 
studies, investigators have correlated IO 
test performances and environmental in- 
dices (amount of education; parents’ edu- 
cational, occupational, and social class 
level; urban-rural differences; etc.). A 
multitude of relationships of this kind, 
often important, have been found. Their 
value may be considered only partially 
attenuated by the discovery of other as- 
sociations which concede greater im- 
portance to heredity (e.g., between IQ 
scores of parents and their children), The 
basic problem stems from the fact that 
broad, background correlations throw in- 
sufficient light on particular environ- 
mental antecedent-consequent relation- 
ships. 

Few studies of any kind in the IQ area 
have been designed with the precision 
necessary to illuminate these relation- 
ships. Some valuable information has 
come out of the work on identical twins 
reared apart, but it is based on sparse 
case data, usually obtained through the 
retrospective reports of biased informants. 
With radical and lifelong differences in 
their environments, twins have often 
shown marked differences in IQ scores 
in later years, up to as much as 24 points. 
In fact, twins have been found to differ 
in IQ almost in proportion to the degree 
of discrepancy experienced in cognitive 
features of their environments (Newman, 
Freeman, & Holzinger, 1937). Wood- 
worth (1941), tallying data from existing 
studies, derived a correlation of .79 be- 
tween differences in amount of education 
and differences in IQ scores. 


Investigations on adopted children 
(mainly, Burks, 1928; Freeman, Hol- 
zinger, & Mitchell, 1928; Leahy, 1935; 
Skodak, 1939; Skodak & Skeels, 1949) 
provide another good though still im- 
precise source of information regarding 
environmental influences on IO scores, 
Many of the children were placed for 
permanent adoption when only a few 
weeks old and were sometimes followed 
regularly over many years. But IQ meas- 
ures were not always taken during the 
early years and the kind of training the 
children received was never specified nor 
controlled. As a result, the effect of ex- 
perience, especially early experience, upon 
intellectual development remained es- 
sentially unknown. 

Among other important methodological 
oversights has been the failure to consider 
the influence of prenatal and neonatal 
factors or of selective placement. In ad- 
dition, sample homogeneity has usually 
been greater among the foster children 
than among their controls. These prob- 
lems are discussed at length in other 
sources (Anastasi, 1958; Jones, 1954). 
The typical IQ correlations between 
foster children-natural parents have 
ranged from .4 to .5. But it is evident 
that these correlations represent inflated 
values due to selective placement and 
sample homogeneity of the foster chil- 
dren. These two factors also have mini- 
mized IQ correlations between foster 
parents-foster children, further obscuring 
the influence of the environment. Never- 
theless, in the Skodak and Skeels (1949) 
longitudinal study of 100 foster children, 
the mean IQ difference between foster 
children (from the age of less than 6 
months through 13 years) and their 
natural mothers remained consistently at 
about 22 points. This is a sizable differ- 
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ence to persist in the face of methodologi- 
cal factors conceivably working in an op- 
posite direction. 

Historical surveys of “gifted” children, 
if again more descriptive than precise, 
have furnished additional, important 
clues on the function of early cognitive 
stimulation (Cox, 1926; Davidson, 1931). 
The association between cognitive pre- 
cocity and the application of intensive 
stimulation from infancy has always been 
impressively high. This suggests a need 
for revising the concept gifted, since it is 
so heavily weighted in favor of heredity 
alone. 

In fact, this writer has managed to 
assemble from various sources a sample 
of 25 superior IQ children, all of whom 
learned to read by the age of 3 (Cox, 
1926; Davidson, 1931; Dolbear, 1912; 
Hollingworth, 1926, 1942; Jones, 1923; 
Root, 1921; Stoner, 1914; Terman, 1917, 
1918, 1924), Of these, 72% had definitely 
enjoyed a great deal of unusually early 
and intensive cognitive stimulation. For 
the other 28% evidence regarding the 
quality and quantity of stimulation was 
lacking in the records. 

Where long-term training has been 
used at all, most programs have taken 
the form of nursery school education. 
These usually have been broad and un- 
certain in meaning and have seldom con- 
centrated upon verbal development, an 
important component of many IQ tests 
(Anastasi, 1958; Wellman & McCandless, 
1946 yd sai 

Of all the many studies of IQ, only 
four have developed long-term programs 
of general cognitive stimulation for pre- 
school children. One of these is a study in 
progess by this investigator on three pairs 
of identical twins and a set of triplets. 
Two studies included no children younger 
than 43 months of age. In one study, 


Dawe (1942) followed the progress in 
language and general cognition that 11 
children made over 3 months of weekend 
training. Details of the investigation 
were reported in the section on language. 
In addition to language gains, her sub- 
jects made significant mean gains in Binet 
IQ scores (14.2 points against a 2-point 
loss for the controls) as well as in other 
cognitive measures, i.e., science and home 
living information. 

McCandless (1940) attempted to raise 
the intellectual level of 6 very bright 
(139 IQ) preschool children by means of 
an enriched curriculum supplementing 
the regular nursery school program. The 
children’s mean age was about 52 months. 
The program consisted of project work 
(constructing a farm and a combination 
flower store-hotel) presented over much 
of 1 school year. Initial post-test differ- 
ences in IQ scores (1916 Stanford) be- 
tween the experimental group and their 
matched controls were not significant. 
However, retest differences the following 
fall reached significance on the newly re- 
vised (1937) Stanford. The retest shift 
was attributed mainly to the nature of the 
1937 test revision, which corrected for the 
decline in age associated with the 1916 
Stanford. These results may appear more 
impressive when one questions just how 
stimulating this kind of project work could 
be for children already of high ability— 
particularly given the Binet’s heavy use of 
verbal symbols by this age. 

Peters and McElwee (1944) furnished 
8 months of guided play to 6 young 
subjects (aged 2-9 to 4-2) of below aver- 
age IQ who attended nursery school three 
mornings per week, Activities were or- 
ganized according to categories of “func- 
tional intelligence,” although the amount 
of verbal stimulation offered is not clear. 
Home visits and conferences with the 
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mother were also included. Although 
there were no controls, children regis- 
tered a mean gain of 7 IQ points. While 
not statistically significant (.07), this in- 
cluded one child whose score fell as a 
result of obvious motivational distraction 
during posttesting. Taking these three 
studies together, their relatively well- 
outlined and lengthy cognitive educa- 
tional programs contain many implica- 
tions for education and the meaning of 
IQ measures. 

The extensive work done on intelli- 
gence in relation to the nature-nurture 
problem has been the subject of vigorous 
discussion and conflicting findings over 
many years (cf. Anastasi, 1958). But one 
regrettable consequence has been the 
manner in which arguments over the rela- 
tive importance of heredity and environ- 
ment have obscured the fact that the 
environment does perform an essential 
role in development. It is difficult to 
argue, considering all the evidence, that 
environment has a negligible role in pro- 
ducing mental test variations or in de- 
veloping intelligence and conceptual 
abilities, however important genetic fac- 
tors may also be. The dispute has seri- 
ously retarded interest in experimental 
work on preschool cognitive learning. It 
also has discouraged long range educa- 
tional programs aimed at developing each 
child to near the maximum level of his 
capacities. . . . 


READING ABILITY 


Nearly all cases of early reading come 
to light from historical sources or from 
surveys of gifted children. Information is 
most detailed in the accounts of children 
taught individually in the home by tutors, 
parents, or other relatives (Cox, 1926; 
Davidson, 1931; Dolbear, 1912; Holling- 


worth, 1926, 1942; Root, 1921; Sidis, 
1911; Stoner, 1914; Terman, 1918; Witte, 
1914). These accounts prove to be one 
of the best stimulants for encouraging 
research on cognitive learning in early 
childhood. Methods are sometimes fairly 
well described. Much of this early child- 
hood education has been devoted to 
general knowledge, and many “home edu- 
cators” have shared a strong belief in 
intensive education from birth as a sine 
qua non for the ontogeny of high intelli- 
gence. 

Winifred Stoner (Stoner, 1914; Grif- 
fiths, 1923) was given a carefully graduated 
program of reading and wide general 
knowledge by her mother from the age 
of 6 months on. By 16 months she could 
read and spell, by 2 years she could 
write. No definite degree of proficiency 
is specified until age 3, when she had 
reportedly acquired much skill in all and 
was beginning to typewrite. The child 
otherwise participated actively in physical 
and dramatic peer play and from child- 
hood on experienced much school and 
and some literary success. Although a con- 
troversial lay educational figure, the 
mother enjoyed considerable support 
from professionals. Her reading instruc- 
tion methods (Stoner, 1914, 1916) in 
some ways typical of many home educa- 
tors, consisted primarily of synthesizing 
words, using phonic principles, along 
with reading simple texts. Letters were 
presented initially in enlarged, colorful 
cutout forms and learning was further 
reinforced through an endless variety of 
songs, plays, games, and stories. 

The case of Viola Olerich (Dolbear, 
1912) is of interest in that she was 
adopted at 8 months by a professor, 
Olerich, expressly for demonstrating his 
ideas on the early development of abili- 
ties. He succeeded in teaching the child 
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to read by a sentence method shortly 
after the age of 17 months. By the age 
of 2-1] she could read with “force and 
suggestion” almost any reading material 
presented to her. 

An earlier illustration is furnished by 
a German clergyman, Witte (1914), who, 
before the son’s birth in 1800, predicted 
the high intellectual abilities which his 
son later acquired with the help of pains- 
taking programing from infancy. The 


child learned to read and spell fluently 
well before 5, through an alphabet-phonic 
method. He also became an exceptionally 
thoughtful and well-informed, yet modest 
child. Attaining his doctorate easily at 14 


he later rose to eminence as a leading 
university scholar in literature. 

Many other examples of precocious 
readers could be cited. Some of these, 
like Macauley, John Stuart Mill, Francis 
Galton (Cox, 1926; Terman, 1917), and 
Norbert Wiener (1953), came to be re- 
nowned thinkers of their time. All of 
them experienced intensive cognitive edu- 
cation from the earliest years. 

Experimental investigation of early 
reading is restricted to some five studies,? 
plus a sixth on which this investigator 
is working. Of three early studies, 
Davidson’s (1931) study on 3-, 4, and 
5-year-old children was the most exten- 
sive. The children were divided by age 


2The paucity of interest in this area, 
especially on the part of psychologists, is 
underscored by the fact that three of these 
studies were all performed at one place, 
Stanford, more than 30 years ago (Brown, 
1924; Davidson, 1931; Terman, 1918), 
one of which was a report by Terman on 
an experiment by a parent; and the fact 
that, of the other two (Fowler, 1962; 
Moore & Anderson, 1960), one is by a 
sociologist (Moore & Anderson, 1960). 


and ability into 3 groups of 4-5 children 
each, all having an MA of 4 years. The 
mean IQs of the respective groups were 
128, 98, 77 on the 1916 Stanford. 

Four months of individual and group 
reading instruction were offered 10-15 
minutes daily in a morning kindergarten- 
type program. A word-sentence method 
was used, with the aid of play activity, 
motivating techniques, but drawing some 
attention to structural detail. 

In the course of training, nearly all 
children made definite headway in learn- 
ing to read simple primer material. ‘Two 
of the bright 3-year-olds covered the 
equivalent of a first grade program in less 
than half a school year and were rapidly 
becoming fluent readers. Moreover, at 
least one (with signs of another) of the 
4-year-olds of average IQ was on the 
verge of fluent reading, while one dull 
5-year-old was making substantial prog- 
ress. 

An outstanding feature of this experi- 
ment is that these results were obtained 
even with average and low IQ children 
well before the usual school age of 6. 
Another is that mean IQ increases of 9.2, 
9.75, and 10.75 points were obtained by 
the respective 3-, 4-, and 5-year-old groups 
over so relatively brief a period. Still 
another emerges in the fact that exten- 
sive cognitive stimulation at home (al- 
most daily parental story reading) had 
been experienced only by the best read- 
ers (all four bright 3-year-olds). In con- 
trast, only one other child had been read 
to more than occasionally—and she was 
the most successful 4-year-old reader. 

In another early study, Brown (1924) 
experimented on short-term word train- 
ing (nouns only) with 12 children, aged 
3-6 to 5-11 and with another child of 
only 22 months. She followed a stencil- 
tracing method, together with the use of 
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printed flash cards, posters, and a primer, 
sustaining motivation by the use of games. 
Two children, a girl aged 3-10, whose 
IQ was only 91, and a boy of 3-6, whose 
IQ was 140, were given 20- to 30-minute 
individual reading lessons in their homes, 
5 days a week for 3 months. 


Catherine, in 36 lessons, learned to read 
11 pages of her primer. Roger in 26 lessons, 
reached the same point. Both children 
could read their charts, and the recombina- 
tion of words upon the charts, with perfect 
ease (Brown, 1924, p. 135). 


With respect to short-term word learn- 
ing, even the child of 22 months, whose 
IQ was only 118, learned to discriminate 
three words in only five lessons. She still 
recognized them 3 months later. 

One of the most remarkable and suc- 
cessful experiments in early reading was 
performed by a lay educator. It is in- 
cluded here because of its unusual veri- 
fication and documentation, reported by 
Terman (1918). This anonymous father 
began to teach his daughter, Martha, to 
tead from the age of 14 months, when her 
speech was limited to just three words. 
He first taught her the capital letters, so 
that the child’s fourth spoken word was 
“pretty B” (pretty, being the third). 
Otherwise he followed a sight word 
method, employing play oriented tech- 
niques and fabricating simplified sentence 
charts. 

Success was far from immediate, how- 
ever. The next five months were passed 
primarily in teaching the child word- 
object relationships. Apparently, at 19 
months certain important concepts de- 
veloped, for Martha rather suddenly in 1 
month rapidly mastered, first, all capital 
then the small letters. At 21 months and 
10 days, with a reading vocabulary of 35 
words, she made some generalization to 
the effect “that these word pictures rep- 


resented thoughts” (p. 223) occurred. At 
23 months Martha “began to experience 
the mental pleasure of reading,” (p. 225) 
and had acquired a reading vocabulary of 
150 words. By 26.5 months, she had 
covered 4.5 primers, embracing a voca- 
bulary of over 700 words. She could read 
fluently and meaningfully, but her pro- 
nunciation was less perfected. 

This case is unique in providing well- 
verified evidence of how a child of not 
more than 140 IO and MA of just 3-0 
years (extrapolated from a 1916 Stanford 
given at age 3-11) learned to read. 

Of the three recent investigations, 
complete data is available only on one, 
an extensive monograph by Fowler 
(1962). He reports on a 9 months’ ex- 
ploratory effort to teach his 2-year-old 
daughter, Velia, to read, experimenting 
with a combination of methods in a trial- 
and-error, but carefully regulated ap- 
proach. Stimulation averaged 30 minutes 
daily and was freely immersed in dramatic 
play and family routines. 

During the program the subject ac- 
cumulated an out-of-context, recognition 
vocabulary of about 250 words. Words 
tested had not been exposed to the sub- 
ject for a mean of 18.5 days and were 
recognized with about 87.3% accuracy. 
Toward the end Velia could read mean- 
ingfully a few isolated, primer-type 
sentences, 2-5 words in length. She was 
also beginning to read preprimers, and 
could perceive words with increasing pre- 
cision using phonic cues. 

The child had also experienced a 
planned, broad program of intensive 
cognitive stimulation from her earliest 
weeks. This experience is believed to have 
been a major factor developing Velia’s 
IQ to the high range (150-170) within 
which Velia scored on all tests from age 
2 to 8. Moreover, in preliminary pilot 
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work, she learned to identify with ease 
all capitals at 21 months and most small 
letters by 23 months. 

Among techniques and dimensions ex- 
plored at some length were dramatic 
play, reinforcement procedures, phonics, 
whole-word learning, and the effect of 
varying type style and size. Picture- 
association and various other materials 
and methods of presenting stimuli were 
similarly experimented with. 

Follow-up tests and observations to age 
8.5 have repeatedly revealed Velia to be 
reading avidly with comprehension and 
facility 2-3 grades above level. In addi- 
tion, she continues to pursue enthusiasti- 
cally a wide variety of other cognitive and 
social interests. It is worth recording that 
she is less advanced in certain cognitive 
areas, e.g, arithmetic, where she has re- 
ceived little special stimulation. Emo- 
tional problems are covered separately 
under psycho-social development. 

Investigations in progress by Moore 
and Anderson (1960) on early reading 
and writing, are as yet published only in 
film form. From limited information,’ it 
appears that several children, aged 3-5, 
have made definite progress in learning to 
read and write. One child, who started at 
2-7, apparently reached a second grade 
level 6 months later. Of special interest 
is their method involving the use of an 
electric typewriter (using correct finger- 
ing), which probably enhances motiva- 
tions as well as facilitates learning. . . . 


MATHEMATICS 


That long periods of learning are indis- 
pensable for the early acquisition of cal- 
culating and similar abilities is suggested 


30. K. Moore, personal communication, 
1961. 


by the following: case records, although 
often less complete than those on early 
reading, similarly point to years of excep- 
tional, early stimulation and practice as 
the rule (Bell, 1937; Jakobsson, 1944; and 
others), Second, there is much evidence 
to suggest that the preschool child’s suc- 
cessful efforts to attain high abilities have 
frequently been early and liberally rein- 
forced and channelized by such social role 
labels as “wizard” or “genius” calculator 
(Barlow, 1951; Mitchell, 1907; and 
others). Finally, it is unreasonable to be- 
lieve that even the “simpler” mathemati- 
cal concepts, thousands of years in the 
attainment historically (Sarton, 1952, 
1959), could emerge autogenously in un- 
tutored children, following Dennis’ and 
Dennis’ (1951) notion. 

Yet even contemporary research on the 
numerical abilities of preschool children, 
as in other cognitive areas, is still highly 
concentrated on merely registering the 
ages and order of normal development. It 
is as if the development of abilities does 
indeed evolve autogenously or through 
maturation alone. In fact, no experiments 
were found which were directly concerned 
with how, or the degree to which, pre- 
school children can learn quantitative re- 
lationships and numbers, Nor do educa- 
tional theory and practice make any 
provision for teaching arithmetic before 
age 5, any more than they do for reading. 
Similarly, MA concepts of arithmetic 
“readiness” have, for elementary school 
programs, been interpreted rigidly in 
terms of age norms (e.g., Harding, 1959; 
Washburne, 1928). 

The observations of Ilg and Ames 
(1951) illustrate this maturational out- 
look. Developmental gradients on several 
aspects of the number process at 6-month 
intervals from the age of 1 year through 
9 years have been catalogued. In their 
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usual fashion little attention is devoted to 
learning processes, mental growth being 
the descriptive framework. Similar collec- 
tions of developmental observations on 
number concepts in early childhood have 
been assembled by Descoeudres (1946), 
Giltay (1936), and Long and Welch 
(1941). Piaget and Szeminska (1952) 
have also worked in this area, although 
they are more concerned with theory 
than with facts. Probably the most im- 
portant modal shift in the acquisition of 
number concepts involves moving from 
simple perception of “oneness” and “two- 
ness,” or broad discriminations of quan- 
tity, to comprehension and accurate per- 
ception of three or more units. This takes 
place usually around the age of 3.5. But 
nearly every study finds some children 
who make this basic transition toward 
functional mastery of the number system 
at the age of 3 or younger (and some at 
older ages). Therefore, unless the explana- 
tion is assumed to be totally a genetic 
one, the now unprobed differences in 
learning opportunities should be investi- 
gated. This point is brought into sharper 
relief by Ilg’s and Ames’ (1951) observa- 
tion that adding behavior begins primarily 
at 5 and 6, precisely the ages when most 
children enter elementary school. . . . 


DISCUSSION AND SUMMARY 


This critical survey of selected litera- 
ture on cognitive learning in early child- 
hood has been made in order to gain 
perspective on certain crucial but widely 
neglected research problems. Neglect of 
these problems has resulted in a stress on 
genetic factors in early cognitive develop- 
ment. Correspondingly, this has been at 
the expense of visualizing the scope and 
complexity of learning realizable during 
the initial phases of development. 


Traditionally, there appear to have been 
two major viewpoints explaining processes 
of development, and to account for the 
protracted course children go through to 
acquire complex knowledge. The first view 
fixes on concepts derived from biology. 
Under this view, intelligence and various 
abilities are postulated as inherited. They 
emerge through a process of unfolding 
along a growth continuum in several or- 
dered stages of maturation. Modification 
of this innately determined patterning by 
means of environmental circumstances is 
placed in secondary position. 

In research, this view has led to a con- 
centration on empirical studies organized 
cross-sectionally for collecting normative 
data. For the most part, these norms have 
been linked sequentially to chronological 
age levels (e.g., MA or any age-trait be- 
havior). The use of longitudinal studies 
has been, logically, an important addi- 
tional derivative of this view. But a 
maturationally oriented developmental 
framework has so dominated long range 
investigations made under its jurisdiction, 
as to cloud evidence which might have 
led to alternate conclusions. In addition, 
there are other important research errors 
and orientations which have tended to 
feed this bias. These include the frequent 
omission of adequate controls; the experi- 
mental fusion of variables; an emphasis 
on sensory-motor and social-emotional 
development to the relative exclusion of 
complex, perceptual-cognitive processes; 
and, above all, the simple omission of 
(antecedent) experiential data. 

An important group of better con- 
trolled studies has probed the maturation 
versus learning issue. These studies have, 
in the main, continued subordinate to 
maturationally oriented hypotheses; have 
failed to separate general experience from 
maturation; and have too often designed 
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training programs with only simple ma- 
terial and/or have covered too short a 
time span. These limitations have aborted 
opportunities for impressive gains to ac- 
crue in cognitive learning. 

The second more or less opposing view, 
while according a greater role to experi- 
ence, has generally been dominated by a 
behavioristic outlook. In its concern for 
dealing with operationally definable proc- 
esses, this outlook has only recently begun 
to divest itself of a molecular focus which 
has relegated complex conceptual proc- 
esses to the second-class status of “inter- 
vening variables.” This outlook also has 
generated a situational focus abstracted 
from the molar life situation, history, and 
developmental status of the organism. 

Preoccupation with precision and accu- 
rate measurement has induced many be- 
havioral researchers to cling to high 
control, animal experimentation of the 
laboratory. This has meant a comparative 
neglect of experimentation on learning in 
children, The less frequent investigation 
of children has been much confined to 
correlational or cross-sectional study of a 
few isolated components of behavior. 
Learning processes, where studied, have 
embraced problems whose solution de- 
pends only upon a few simple operations 
acquired over a restricted number of trials. 
Little attention has been directed toward 
longitudinal work on the antecedent- 
consequent relations of basic cognitive 
dimensions. . . . 

Much if not most of the energy in child 
psychology and development in late years 
has been concentrated on the child’s per- 
sonality, perceptual motor, and socio- 
emotional functioning and development. 
Originating primarily as a reaction to his- 
torically inadequate and stringent meth- 
ods, fears have generalized to encompass 


early cognitive learning per se as intrin- 
sically hazardous to development. As 
legitimate areas of study, the contribu- 
tions of studies on perceptual-motor and 
socioemotional problems are obvious. 
But in the field of child guidance, interest 
in these areas has come to permeate and 
dominate work in child development 
almost to the exclusion of work on cogni- 
tive learning. In harking constantly to the 
dangers of premature cognitive training, 
the image of the “happy,” socially adjusted 
child has tended to expunge the image of 
the thoughtful and intellectually educated 
child. Inevitably, in this atmosphere, re- 
search (and education) in cognition has 
lagged badly, especially since the 1930s, 
not only for the early years of childhood 
but for all ages. 

Even prior to the more recent era, how- 
ever, very little careful research was done 
on early cognitive learning. As historical 
evidence shows, most studies have com- 
prised the work of those “beyond the 
pale” of formal psychology. Yet, taken 
collectively, the findings are so provoca- 
tive as to make us entertain hopes that 
many, if not all, children can and indeed 
should be offered much more cognitive 
stimulation than they have been generally 
receiving. 

There is, however, a further problem, 
at once a derivative of and an important 
contributor to the failure to undertake 
work on cognitive learning. Few system- 
atic methods have been devised for edu- 
cating young children, especially in com- 
plicated subject matter. . . . 

The advantages of utilizing the now 
relatively untapped “preschool” years for 
cognitive education are of course manifest. 
Most obvious, is the availability of more 
years of childhood to absorb the increas- 
ingly complex technology of modern so- 
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ciety, a technology already requiring many 
of the more productive years of develop- 
ment to acquire. . . . 
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Conditioned Emotional Reactions * 


John B. Watson and Rosalie Rayner 


* From J. B. Watson and R. Rayner, Con- 
ditioned emotional reactions, J. exp. Psy- 
chol., 3, 1-14 (1920). Reprinted by per- 
mission of the American Psychological 
Association. 


In recent literature various speculations 
have been entered into concerning the 
possibility of conditioning various types 
of emotional response, but direct experi- 
mental evidence in support of such a view 
has been lacking. If the theory advanced 
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by Watson and Morgan! to the effect 
that in infancy the original emotional re- 
action patterns are few, consisting so far 
as observed of fear, rage and love, then 
there must be some simple method by 
means of which the range of stimuli 
which can call out these emotions and 
their compounds is greatly increased. 
Otherwise, complexity in adult response 
could not be accounted for. These au- 
thors without adequate experimental evi- 
dence advanced the view that this range 
was increased by means of conditioned 
reflex factors. It was suggested there that 
the early home life of the child furnishes 
a laboratory situation for establishing con- 
ditioned emotional responses, The pres- 
ent authors have recently put the whole 
matter to an experimental test. 

Experimental work has been done so 
far on only one child, Albert B. This in- 
fant was reared almost from birth in a hos- 
pital environment; his mother was a wet 
nurse in the Harriet Lane Home for In- 
valid Children. Albert’s life was normal: 
he was healthy from birth and one of the 
best developed youngsters ever brought 
to the hospital, weighing twenty-one 
pounds at nine months of age. He was on 
the whole stolid and unemotional. His 
stability was one of the principal reasons 
for using him as a subject in this test. We 
felt that we could do him relatively little 
harm by carrying out such experiments as 
those outlined below. 

At approximately nine months of age 
we ran him through the emotional tests 
that have become a part of our regular 
routine in determining whether fear reac- 


1 “Emotional Reactions and Psychologi- 
cal Experimentation,” American Journal of 
Psychology, April, 1917, Vol. 28, pp. 163- 
174. 


tions can be called out by other stimuli 
than sharp noises and the sudden removal 
of support. Tests of this type have been 
described by the senior author in another 
place. In brief, the infant was confronted 
suddenly and for the first time succes- 
sively with a white rat, a rabbit, a dog, a 
monkey, with masks with and without 
hair, cotton wool, burning newspapers, 
etc. A permanent record of Albert’s reac- 
tions to these objects and situations has 
been preserved in a motion picture study. 
Manipulation was the most usual reac- 
tion called out. At no time did this infant 
ever show fear in any situation. These 
experimental records were confirmed by 
the casual observations of the mother and 
hospital attendants. No one had ever seen 
him in a state of fear and rage. The infant 
practically never cried. 

Up to approximately nine months of 
age we had not tested him with loud 
sounds. The test to determine whether a 
fear reaction could be called out by a loud 
sound was made when he was eight 
months, twenty-six days of age. The sound 
was that made by striking a hammer upon 
a suspended steel bar four feet in length 
and three-fourths of an inch in diameter. 
The laboratory notes are as follows: 


One of the two experimenters caused the 
child to turn its head and fixate her moving 
hand; the other, stationed back of the child, 
struck the steel bar a sharp blow. The child 
started violently, his breathing was checked 
and the arms were raised in a characteristi 
manner. On the second stimulation t 
same thing occurred, and” ‘in: addition™t 
lips began to pucker ahd \tremble. On. th x 
third stimulation the ‘child broke into a 


| 


2 “Psychology from the Standpoint of a 
Behaviorist,” p. 202) N J 
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sudden crying fit. This is the first time an 
emotional situation in the laboratory has 
produced any fear or even crying in Albert. 


We had expected just these results on 
account of our work with other infants 
brought up under similar conditions. It is 
worth while to call attention to the fact 
that removal of support (dropping and 
jerking the blanket upon which the in- 
fant was lying) was tried exhaustively 
upon this infant on the same occasion. It 
was not effective in producing the fear re- 
sponse. This stimulus is effective in 
younger children, At what age such stim- 
uli lose their potency in producing fear is 
not known. Nor is it known whether less 
placid children ever lose their fear of 
them. This probably depends upon the 
training the child gets. It is well known 
that children eagerly run to be tossed 
into the air and caught. On the other 
hand it is equally well known that in the 
adult fear responses are called out quite 
clearly by the sudden removal of support, 
if the individual is walking across a 
bridge, walking out upon a beam, etc. 
There is a wide field of study here which 
is aside from our present point. 

The sound stimulus, thus, at nine 
months of age, gives us the means of test- 
ing several important factors. I. Can we 
condition fear of an animal, e.g., a white 
rat, by visually presenting it and simul- 
taneously striking a steel bar? II. If such 
a conditioned emotional response can be 
established, will there be a transfer to 
other animals or other objects? III. What 
is the effect of time upon such condi- 
tioned emotional responses? IV. If after 
a reasonable period such emotional re- 
sponses have not died out, what labora- 
tory methods can be devised for their 
removal? 

I. The establishment of conditioned 
emotional responses. At first there was 


considerable hesitation upon our part in 
making the attempt to set up fear reac- 
tions experimentally. A certain responsi- 
bility attaches to such a procedure. We 
decided finally to make the attempt, com- 
forting ourselves by the reflection that 
such attachments would arise anyway as 
soon as the child left the sheltered en- 
vironment of the nursery for the rough 
and tumble of the home. We did not 
begin this work until Albert was eleven 
months, three days of age. Before at- 
tempting to set up a conditioned response 
we, as before, put him through all of the 
regular emotional tests. Not the slightest 
sign of a fear response was obtained in 
any situation. 

The steps taken to condition emotional 
responses are shown in our laboratory 
notes. 


11 Months 3 Days 


1. White rat suddenly taken from the 
basket and presented to Albert. He began 
to reach for rat with left hand. Just as his 
hand touched the animal the bar was 
struck immediately behind his head. The 
infant jumped violently and fell forward, 
burying his face in the mattress. He did 
not cry, however. 

2. Just as the right hand touched the 
rat the bar was again struck. Again the 
infant jumped violently, fell forward and 
began to whimper. 

In order not to disturb the child too 
seriously no further tests were given for 
one week. 


11 Months 10 Days 


1. Rat presented suddenly without 
sound. There was steady fixation but no 
tendency at first to reach for it. The rat 
was then placed nearer, whereupon tenta- 
tive reaching movements began with the 
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right hand. When the rat nosed the in- 
fant’s left hand, the hand was immediately 
withdrawn. He started to reach for the 
head of the animal with the forefinger of 
the left hand, but withdrew it suddenly 
before contact. It is thus seen that the two 
joint stimulations given the previous week 
were not without effect. He was tested 
with his blocks immediately afterwards to 
see if they shared in the process of condi- 
tioning. He began immediately to pick 
them up, dropping them, pounding them, 
etc, In the remainder of the tests the 
blocks were given frequently to quiet him 
and to test his general emotional state. 
‘They were always removed from sight 
when the process of conditioning was 
under way, 

2. Joint stimulation with rat and sound. 
Started, then fell over immediately to 
right side. No crying. 

3. Joint stimulation, Fell to right side 
and rested upon hands, with head turned 
away from rat. No crying. 

+. Joint stimulation, Same reaction. 

5. Rat suddenly presented alone. Puck- 
ered face, whimpered and withdrew body 
sharply to the left. 

6. Joint stimulation. Fell over immedi- 
ately to right side and began to whimper. 

7. Joint stimulation, Started violently 
and cried, but did not fall over. 

8. Rat alone. The instant the rat was 
shown the baby began to cry. Almost in- 
stantly he turned sharply to the left, fell 
over on left side, raised himself on all 
fours and began to crawl away so rapidly 
that he was caught with difficulty before 
teaching the edge of the table. 

This was as convincing a case of a com- 
pletely conditioned fear response as could 
have been theoretically pictured. In all 
seven joint stimulations were given to 
bring about the complete reaction. It is 
not unlikely had the sound been of greater 


intensity or of a more complex clang char- 
acter that the number of joint stimula- 
tions might have been materially reduced. 
Experiments designed to define the na- 
ture of the sounds that will serve best as 
emotional stimuli are under way. 

II. When a conditioned emotional re- 
sponse has been established for one ob- 
ject, is there a transfer? Five days later 
Albert was again brought back into the 
laboratory and tested as follows: 


11 Months 15 Days 


1. Tested first with blocks: He reached 
readily for them, playing with them as 
usual. This shows that there has been no 
general transfer to the room, table, blocks, 
ete. 

2. Rat alone. Whimpered immediately, 
withdrew right hand and turned head and 
trunk away. 

3. Blocks again offered. Played readily 
with them, smiling and gurgling. 

4. Rat alone. Leaned over to the left 
side as far away from the rat as possible, 
then fell over, getting up on all fours and 
scurrying away as rapidly as possible. 

5. Blocks again offered. Reached im- 
mediately for them, smiling and laughing 
as before. 

The above preliminary test shows that 
the conditioned response to the rat had 
carried over completely for the five days 
in which no tests were given. The question 
as to whether or not there is a transfer 
was next taken up. 

6. Rabbit alone. The rabbit was sud- 
denly placed on the mattress in front of 
him. The reaction was pronounced. Nega- 
tive responses began at once. He leaned 
as far away from the animal as possible, 
whimpered, then burst into tears. When 
the rabbit was placed in contact with him 
he buried his face in the mattress, then 
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got up on all fours and crawled away, cry- 
ing as he went. This was a most convinc- 
ing test. 

7. The blocks were next given him, 
after an interval. He played with them as 
before. It was observed by four people 
that he played far more energetically with 
them than ever before. The blocks were 
raised high over his head and slammed 
down with a great deal of force. 

8. Dog alone. The dog did not produce 
as violent a reaction as the rabbit. The 
moment fixation occurred the child 
shrank back and as the animal came 
nearer he attempted to get on all fours 
but did not cry at first. As soon as the 
dog passed out of his range of vision he 
became quiet. The dog was then made to 
approach the infant’s head (he was lying 
down at the moment). Albert straight- 
ened up immediately, fell over to the 
opposite side and turned his head away. 
He then began to cry. 

9. The blocks were again presented. 
He began immediately to play with them. 

10. Fur coat (seal), Withdrew imme- 
diately to the left side and began to fret. 
Coat put close to him on the left side, he 
turned immediately, began to cry and 
tried to crawl away on all fours. 

11. Cotton wool. The wool was pre- 
sented in a paper package. At the end the 
cotton was not covered by the paper. It 
was placed first on his feet. He kicked it 
away but did not touch it with his hands. 
When his hand was laid on the wool he 
immediately withdrew it but did not show 
the shock that the animals or fur coat pro- 
duced in him. He then began to play with 
the paper, avoiding contact with the wool 
itself, He finally, under the impulse of the 
manipulative instinct, lost some of his 
negativism to the wool. 

12. Just in play W. put his head down 
to see if Albert would play with his hair. 


Albert was completely negative. Two 
other observers did the same thing. He 
began immediately to play with their hair. 
W. then brought the Santa Claus mask 
and presented it to Albert. He was again 
pronouncedly negative. . . . 

From the above results it would seem 
that emotional transfers do take place 
Furthermore it would seem that the num- 
ber of transfers resulting from an experi- 
mentally produced conditioned emotional 
reaction may be very large. In our observa- 
tions we had no means of testing the coin- 
plete number of transfers which may have 
resulted... . 

IV. “Detachment” or removal of con- 
ditioned emotional responses. Unfortu- 
nately Albert was taken from the hospital 
the day the above tests were made. Hence 
the opportunity of building up an experi- 
mental technique by means of which we 
could remove the conditioned emotional 
responses was denied us. Our own view, 
expressed above, which is possibly not 
very well grounded, is that these responses 
in the home environment are likely to 
persist indefinitely, unless an accidental 
method for removing them is hit upon. 
The importance of establishing some 
method must be apparent to all. Had the 
opportunity been at hand we should have 
tried out several methods, some of which 
we may mention. (1) Constantly con- 
fronting the child with those stimuli 
which called out the responses in the 
hopes that habituation would come in 
corresponding to “fatigue” of reflex when 
differential reactions are to be set up. 
(2) By trying to “recondition” by show- 
ing objects calling out fear responses 
(visual) and simultaneously stimulating 
the erogenous zones (tactual). We should 
try first the lips, then the nipples and as 
a final resort the sex organs. (3) By trying 
to “recondition” by feeding the subject 
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candy or other food just as the animal is 
shown. This method calls for the food 
control of the subject. (4) By building up 
“constructive” activities around the object 
by imitation and by putting the hand 
throngh the motions of manipulation. At 
this age imitation of overt motor activity 
is strong, as our present but unpublished 
experimentation has shown. 


INCIDENTAL OBSERVATIONS . os. 


The Freudians twenty years from now, 
unless their hypotheses change, when they 
come to analyze Albert’s fear of a seal skin 
assuming that he comes to analysis 
t age—will probably tease from him 
cital of a dream which upon their 
ysis will show that Albert at three 
years of age attempted to play with the 
pubic hair of the mother and was scolded 
violently for it. (We are by no means 
denying that this might in some other 
case condition it.) If the analyst has suffi- 


ciently prepared Albert to accept such a 
dream when found as an explanation of 
his avoiding tendencies, and if the analyst 
has the authority and personality to put it 
over, Albert may be fully convinced that 
the dream was a true revealer of the fac- 
tors which brought about the fear. 

It is probable that many of the phobias 
in psychopathology are true conditioned 
emotional reactions either of the direct 
or the transferred type. One may possibly 
have to believe that such persistence of 
early conditioned responses will be found 
only in persons who are constitutionally 
inferior. Our argument is meant to be 
constructive. Emotional disturbances in 
adults cannot be traced back to sex alone. 
They must be retraced along at least three 
collateral lines—to conditioned and trans- 
ferred responses set up in infancy and 
early youth in all three of the fundamental 
human emotions. 
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3: 


Single and Multiple Schedules of Reinforcement 
in Developmentally Retarded Children*’ 


Robert Orlando and Sidney W. Bijou? 


Free-operant conditioning methods are 
being used with increasing frequency in a 
wide range of research applications with 
human subjects. Although some of the 
schedules of reinforcement which are of 
central importance in this kind of research 
have been systematically evaluated with 
infrahuman organisms (Ferster & Skinner, 
1957), as yet few studies bear directly on 
questions of generality, variability, and 
special effects of schedule control in hu- 
man Ss (Bijou, 1958; Ellis, Barnett, & 
Pryer, 1960; Green, Sanders, & Equier, 
1959; Holland, 1957; Holland, 1958; Long, 
Hammack, May, & Campbell, 1958). 
Aside from academic issues involved in 


*From R. Orlando and S. W. Bijou, 
Single and multiple schedules of reinforce- 
ment in developmentally retarded children, 
J. exp. anal. Behav., 3, 339-348 (1960). 
Reprinted by permission of the authors and 
the Journal of the Experimental Analysis 
of Behavior. 

1 This investigation was supported by a 
grant (M-2232) from the National Insti- 
tute of Mental Health, Public Health 
Service. 


assumptions that infrahuman data pro- 
vide sufficient bases for application in hu- 
man behavior (Beach, 1960) and the 
need for genuine comparative and devel- 
opmental data, practical research prob- 
lems arise. Typically, extensive “trying 
out” of schedule types and values is nec- 
essary to find appropriate rate, pause dis- 
tribution, resistance to extinction, and 
other features of free-operant behavior for 
studies using human Ss. The results of 
these time-consuming preliminary investi- 
gations are potentially valuable for other 
researchers because they provide empiri- 
cal foundation for the selection of sched- 
ules with maximum sensitivity and con- 
trol. 

The purpose of the present paper is to 
show characteristic performances under 
four basic schedules (VI, FI, VR, and 
FR) and two multiple schedules (mult 
VR ext and mult CRF ext) in human 
Ss, and to illustrate some of the range 
and variability of these features in a pop- 
ulation of institutionalized developmen- 


2The authors wish to express their 
gratitude for the support and assistance of 
Dr. Wesley D. White, Superintendent of 
the Rainier School, Buckley, Washington, 
and to Mr. Russell M. Tyler and Mr. 
David A. Marshall, who served as Research 
Assistants. 
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tally retarded children. However, we did 
not attempt to demonstrate the full range 
of possible schedule values or limiting 
conditions and thresholds. Examples are 
from schedules that have proven useful 
in the study of retarded children. 


Method 
SUBJECTS 


The Ss were 46 institutionalized re- 
tarded children ranging in CA from 9 to 
21 and in IQ from 23 to 64. They were in 
residence from 1 to 16 years. Diagnostic 
categories included mongoloid, epileptic, 
familial, and others; and all were ambula- 
tory. They came on request to the recep- 
tion room of the laboratory from resi- 
dence halls, classrooms, or work assign- 
ments, 

All Ss had previously taken part in a 
study exploring a technique for the rapid 
establishment of multiple-schedule per- 
formance in the same experimental situa- 
tion. Instructions, types of reinforcements, 
intersession intervals, and other conditions 
were the same for all Ss. 


APPARATUS 


The Ss were placed by themselves in an 
8- by 10-foot room furnished with two 
chairs and a small table. The table, fixed 
to the wall next to a one-way observation 
window, contained a sturdy wooden re- 
sponse box and a chute for receiving rein- 
forcers dispensed by a Gerbrands Uni- 


3 The term developmentally retarded is 
used in place of such terms as “feeble- 
minded” and “mentally deficient.” It is 
preferred because it is neutral with respect 
to etiology and avoids mentalistic implica- 
tions. Furthermore, the term is descriptive 
and normative as noted by Cameron and 
Magaret (1951). 


versal Feeder mounted on the other side 
of the wall. The 12- by 16- by 12-inch 
response box was equipped with a 3-inch 
metal press-to-manipulate lever (handle 
gtip for the squeezer of an O-Cedar 
sponge mop). This lever had a 4-inch 
vertical travel, and about a 150-gram pres- 
sure was necessary to operate it. Two 
colored jewel lights on the same front 
panel of the box and a buzzer inside could 
be used for various stimulus events. 

Automatic equipment in an adjoining 
room provided remote control and record- 
ing operations. This consisted of electrical 
circuits, timers, tape-programmers, and 
cumulative recorders similar to those used 
with infrahuman Ss (Ferster & Skinner, 
1957). A 300-watt frosted bulb in the 
center of the ceiling provided general 
illumination (in addition to sunlight from 
an airshaft-facing window), while a 
smaller bulb high over the response box 
served as a “bridge” by going out for 3 
seconds following every reinforcement de- 
livered via the chute. 

The reinforcers were a mixture of com- 
mercially produced candies such as 
Hersheyettes, candy corn, M & M’s, and 
mints. For most Ss, these candies were a 
highly coveted reward. (Many Ss traded 
candy to other children for pencils and 
small toys.) 


PROCEDURE 


Since all of the Ss had had previous 
experience in the situation, each session 
was preceded by minimal instructions: 
“Now it is your turn to get some candy. 
I'll be back when it is time to leave.” 
Original instructions were: “Now it is 
your turn to get some of these (E shows 
a handful of candy). Come with me 
(ushers into the experimental room). Sit 
in this chair (in front of the apparatus). 
Now watch me; I’ll show you how we get 
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candy here (E presses lever five times at 
the rate of 2 per second, and the fifth 
response is reinforced). See? Here’s candy 
for you. Now you do it. You get candy.” 
(Then E leaves the room after S makes 
five independent responses and gets a 
reinforcement.) All sessions were termi- 
nated with, “That’s all for today. Go and 
sit in the waiting room.” 

Sessions were 15 to 60 minutes, depend- 
ing on the rate that reinforcers were 
earned, and typically were scheduled on a 
two-a-week basis. For those Ss who were 
shifted from one schedule to another, a 
criterion of no apparent change for two 
successive sessions was used before shift 
(i.e, essentially no change in over-all rate, 
number of reinforcers earned, duration 
and distribution of pauses, etc.). 

Records were obtained on a Gerbrands 
Cumulative Recorder with paper speeds 
of 30 and 60 centimeters per hour and a 
reset number of 400 responses. With 
multiple schedules, type and duration of 
discriminative stimuli were recorded by a 
special events pen directly under the 
cumulative-response curve. 


Results and Discussion 


Figures 1 through 5 show the cumula- 
tive-response curves of selected Ss under 
a variety of schedules, These illustrate 
representative behaviors, and, in most of 
them, acquisition and transition stages 
have been omitted. When feasible and 
appropriate, segments have been collapsed 
on the abscissa to conserve space. (These 
may be identified by the absence of 
“reset” lines.) Each record is accompanied 
by S numbers (S-1, S-2, etc.), sessions 
numbers consecutive for each S, and 
schedules. 

In Fig. 1 through 4, the paper speed of 
the recorder was 30 centimeters per hour. 


In Fig. 5, it was 30 centimeters per hour 
for Ss 11, 12, and 13, but 60 centimeters 
per hour for Ss 14 and 15. 


VR 


Like infrahuman Ss, retarded Ss pro- 
duce high rates of responding under VR 
which are roughly proportional to the size 
of the ratio, while pauses are infrequent, 
short, and random with respect to time of 
reinforcement. Also, these characteristics 
appear to be rather resistant to change 
with shift of schedule. 

These effects are illustrated in Fig. 1. 
After training on VR 100 (range 40 to 
160), S-1 developed a very high rate with 
practically no pausing (Session 3). A shift 
to FR 25 (Session 4) did not result in any 
discriminable changes in this perform- 
ance, although two DRL schedules (mult 
DRL 10 seconds in Session 5 and DRL 


10 seconds in Session 6) brought the rate 
down somewhat. A comparatively lower 
rate was developed and maintained in 5-2 
(Sessions 3 to 6) on VR 25 (range 15 to 


35). Upon being shifted to FR 25 in 
Session 7, only slight fixed-ratio-like post- 
reinforcement pauses emerged. These are 
shown in Sessions 8 and 10. 


FR 


The FR behavior is similar to that pro- 
duced under VR in that high stable rates 
are common and higher rates are associ- 
ated with lower (more responses per re- 
inforcement) ratios; but pause distribu- 
tion and durations are frequently differ- 
ent. Pauses (of greater duration than 
those associated with “consumatory” be- 
havior) follow reinforcements, and the 
frequency of these pauses decreases as the 
ratio becomes lower. 

The relationship between ratio size and 
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rate can be seen in Fig. 2. Subject S-3 
shows a rate increase when shifted from 
FR 10 (Sessions 3 and 6) to FR 25 (Ses- 
sions 8 and 10), approaching the high rate 
exhibited by S-4 under FR 25 (Sessions 
6,9, and 11) and VR 25 (Session 7). The 
temporary disturbance in postreinforce- 
ment pausing when S-3 was shifted from 
FR 10 to FR 25 illustrates schedule con- 
trol (e.g., the short “runs” in the initial 
part of Session 8 are appropriate to the 
smaller ratio), as does the later shift to 
VR 25, in which an uneven rate and ir- 
regular pause distribution become mani- 
fest. 

The records of S-4 in Fig. 2 represent a 
typical pattern on FR in which pauses do 
not invariably occur after every reinforce- 
ment, but occur only after reinforcement 
(Session 6). After a shift to VR 25 (Ses- 
sion 7), accompanied by an increase in 
rate and decrease in pause frequency, ex- 
tensive training (4 sessions) on FR 25 
was necessary to return behavior to near 
the original FR pattern (Session 11). 

Some Ss (not illustrated) adopt stable 
high rates with no discernible pausing 
under FR. These Ss tend to continue re- 
sponding at undiminished rates even in 
extinction conditions, suggesting that 
some motivational factor may be involved. 
This observation and the interpretation 
are consistent with findings reported by 
Ellis et al. (1960). 


VI 


The VI performances are almost identi- 
cal to those generated under VR of an 
equivalent value. If there are any reliable 
differences, they are probably in greater 
“grain” and perhaps greater incidence of 
essentially random (with respect to time 
of reinforcement) pauses in VI. 


Figure 3 shows a typical VI 0.5 (range 


10 to 50 seconds) performance. A gradual 
increase in rate and decrease in pause fre- 
quency is apparent over sessions (Sessions 
2 to 4). These effects carry over into FI 
0.5 (Sessions 6 and 7) and even into DRL 
0.5 (Session 8), in which no reinforce- 
ments were earned. This record illustrates 
the high resistance to schedule shift pro- 
duced by VI, and is fairly typical of a 
wide range of interval values. 


FI 


Of the four basic types of schedules, the 
FI produces the greatest diversity of be- 
haviors in developmentally retarded chil- 
dren. By and large, individual Ss react to 
FI schedules in consistent ways, but in- 
dividual differences are large, varying from 
“run-away” rates similar to those produced 
by VI schedules to low-rate “pacing.” 
Scalloping is infrequent, although those 
Ss who scallop do so consistently. Some 
medium rates with uneven patterns and 
high grain are also produced. With ex- 
tended training, these Ss usually come 
under schedule control and adopt low 
rates, most of them also producing an oc- 
casional scallop. 

Figure 4 shows the records of Ss under 
FI schedules. Subjects S-6 and S-7 are 
typical examples of low-rate solutions for 
FI 1 with only occasional scallops (Ses- 
sions 2 to 5). These Ss were shifted to 
FR 15 (Session 6) to estimate resistance 
to schedule change. Neither S showed rate 
increase, They were then given an “in- 
creasing-ratio” schedule (beginning in 


` Session 7), in which the number of unre- 


inforced responses between reinforced re- 
sponses is gradually increased (i.e., ratio is 
gradually increased from 1:1 to 1:15). 
Subject S-6 adopted a typical FR pattern 
on the final schedule, but S-7 continued 


SZ ua 
H “ssas 
tv-s 


‘uaspyiyo pəpıiezə3 Ájjejuəwdojəaəp ur zuəwə010}7U13 Jo səjnpəyos əjdnjnw pue 
əjŞurg :nofig pue opurjiQ woi “YA pUe sones 13318; 0} syjrqs pue sauewsoziod ya $urmoys spiooss əanepumy `Z ‘Ola 


Gz d 
6 'ss3s 
-6 


H 


—, 


ez YA $2 us 
2 "SSIS 9 ‘ss3s 
o-s e-s 
y re 
If Ti 
di Ao 
Heide Ti 
| | 
TEER 
ol Jd Ol ud 
9 ‘ss3s € ‘ss3s 
e-s e-s 


31 


i “UsIP[IyO papsejes Aj]e}USWIdO]SAep Ur 3USUII0I0) 
ae - : Æ ri uraa JO səjnpəyəs aid) 
nofig pus opuso wory “TYC PUE pJ Japun aFueyo oj 20uezsisəs pue joszuoo ajnpayos TA aiei cones e e a ET 


go ld 
9 ‘ss3s 
s-s 


CONDITIONAL EMOTIONAL REACTIONS 33 


the original low rate appropriate to the 
FI 1 schedule. 

Subject S-8 in Fig. 4 is an example of 
the Ss who give “scalloping” patterns on a 
iety of FI schedules, Although only 
final stages on each schedule are shown, 
other records appeared very much the 
same except for short periods immedi- 
ately following the shifts. The last record 
for this S (Session 19) shows a ratio-pro- 
duced increase in rate when shifted to 
FR 15, with a tendency for scallops to 
straighten out into ratio runs. 

The records of S-9 illustrate the inter- 
mediate type of reaction to FT 1, with ir- 
regular rate and pause distribution. The 
FI control is weak, showing only in grad- 
ually decreasing rate and occasional scal- 
lops. Subject S-10 is an example of an S 
who started off very much like S-9, but 


FIG. 4. Cumulative records showing the 
variety of performances produced under 
FI. From Orlando and Bijou: Single and 
multiple schedules of reinforcement in 
developmentally retarded children. 


who came under FI control much more 
positively, approaching an optimally low- 
rate solution. 


MULTIPLE SCHEDULES 


Mult VR ext. This schedule, which has 
proved especially useful in the study of 
discrimination learning, consists of two 
components, each signalled by a different 
stimulus (e.g., two colored jewel lights). 
One (e.g. red) serves as an S4, and extinc- 
tion is programmed in its presence; the 
other (e.g, blue) serves as the SP, and a 
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VR schedule is programmed in its pres- 
ence. The two conditions alternate in reg- 
ular fashion, either on a fixed time unit 
(e.g., every 2 minutes) or on variable time 
units (e.g, varying from 0.5 to 3.5 min- 
utes). Discrimination performance is eval- 
uated by an index of the number of cor- 
rect responses (in the presence of S?) to 
the number of incorrect responses (in the 
presence of S4). 

Figure 5 shows three variations in this 
schedule in Ss whose performances met 
high criteria for discrimination. The event- 
pen line at the bottom of the records for 
Ss 11, 12, and 13 indicates the color of the 
stimulus light present (the light serving 
as SP varies). These records were selected 
to illustrate some of the range of sched- 
ules, session durations, and stimulus-alter- 
nation units that have been established 
and maintained. A technique for the rapid 
development of these schedules is de- 
scribed in detail in another paper (Bijou 
& Orlando, in press). 

Mult CRF ext. This multiple schedule 
is a simple variation of interval schedules 
in that a cue is added; that is, reinforce- 
ments are programmed in the same way 
as in interval schedules, but a cue is pre- 
sented at the end of the intezval. This cue 
is withdrawn with every reinforcement 
and re-presented after the required inter- 
val has again elapsed. Discrimination per- 
formance is evaluated by the extent to 
which the S refrains from responding in 
the absence of the cue and the latency of 
response after cue onset. A DRL com- 
ponent requiring that the S pause in the 
absence of the cue may be added as a 
further variation which develops precise 
stimulus control. 

Figure 5 shows records of this schedule 
(mult CRF ext with fixed 9.5 interval) in 
two Ss who met high criteria of discrimi- 
nation (Ss 14 and 15). The event-pen line 


directly beneath the cumulative curves 
records cue duration; length of the line 
in the depressed position therefore repre- 
sents latency. 

The performance of S-14 is an example 
of a typical pattern in which there is al- 
most no responding in the absence of the 
cue, but some rather long latencies occur. 
Subject S-15 responds occasionally during 
the interval (especially in the initial part 
of the session), but has consistently mini- 
mal latencies to cue onset. The lower 
event line in the record of S-15 is used 
to record duration of postreinforcement 
pauses; the pen is depressed by rein- 
forcement and released by the first re- 
sponse. Length of the line in the depressed 
position therefore reflects durations of 
postreinforcement pauses. 


CONCLUSIONS 


The distinctiveness of behaviors gen- 
erated by each type of schedule certainly 
seems no less than in infrahuman Ss, al- 
though individual differences within 
schedule types may have a greater range. 
Response rate is clearly a function of the 
kind and values of schedules (at least 
within the range represented here); higher 
rates are associated with lower ratios, 
longer intervals, and variable rather than 
fixed schedules, Pause distributions and 
durations, along with scalloping and other 
patterning effects, seem less reliably gen- 
erated by schedule control. (For example, 
FR postreinforcement pauses are not al- 
ways stable within or among Ss.) Effects 
are in the expected direction, however. 
For example, postreinforcement pauses 
are more likely in FR than in VR, and 
more likely with higher ratios compared 
with lower ones. 

Stability of schedule control is fairly 
good in retarded children. Few intrases- 
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FIG. 5. Criterion sessions under two multiple schedules, showing variations in schedule 
values and performance. From Orlando and Bijou: Single and multiple schedules of rein- 
forcement in developmentally retarded children. 
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sion or intersession “drifts” have been 
observed, particularly as the behavior 
approaches infrahuman “norms.” Also, 
cumulative effects of warm-up, satiation, 
fatigue, boredom, etc., are minimal with 
candy as reinforcement. 

The greater effectiveness of schedule 
control in retarded children than was re- 
ported for nonretarded children (Long, 
et al., 1958) is probably attributable to 
differences in histories of deprivation and 
the type of reinforcer. Motivation is rarely 
a problem with the retarded, and such 
factors as number of reinforcers, duration 
of sessions, and intersession intervals have 
little effect on performance when candy 
is used. 

Finally, the combination of schedule 
effects and stimulus control generated 
with multiple schedules holds great prom- 
ise for the study of discrimination, gen- 
eralization, and motivation of retarded 
children. More precise control of behavior 
is possible than with simple schedules, 
and performances which are quite sensi- 
tive to experimental conditions are easily 
obtained. 


SUMMARY 


Salient features of the behavior of de- 
velopmentally retarded children as a func- 
tion of simple and multiple schedules of 
reinforcement are illustrated. Effects of 
schedules are similar to those found with 
infrahuman Ss as well as with nonretarded 
children. Two variations of multiple 


schedules are presented as particularly 
well-suited to the study of discrimination, 
generalization, and motivation in children 
because of the combination of stimulus 
and schedule control of performance, 
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Laboratory Control of Thumbsucking by Withdrawal 
and Re-Presentation of Reinforcement*' 


Donald M. Baer 


A 5-year-old boy was shown cartoons, and 
punished for thumbsucking during alternate 
cartoons by turning off the cartoons for as 
long as his thumb remained in his mouth. 
“Thumbsucking weakened during such peri- 
During alternate periods of uninter- 
rupted cartoons, thumbsucking promptly 
recovered, suggesting a quick discrimination 
process. Two other 5-year-old boys were 
shown the same cartoons; withdrawal of the 
cartoons was made contingent upon thumb- 
sucking for one, and randomly yoked for the 
other, Then their roles were reversed. Con- 
tingent withdrawal and re-presentation of 
the cartoons controlled thumbsucking rate; 
yoked withdrawal and re-presentation did 
not. 


od 


Positive reinforcement may be with- 
drawn from young children by showing 
them movie cartoons and programming 
interruptions of both picture and sound 
track. Making such withdrawal contin- 
gent upon a response effectively reduces 


* From D., M. Baer, Laboratory control of 
thumbsucking by withdrawal and re-pres- 
entation of reinforcement, J. exp. anal. 
Behav., 5, 525-528 (1962). Reprinted by 
permission of the author and the Journal 
of the Experimental Analysis of Behavior. 


its frequency (Baer, 1961); and the delay 
of such withdrawal by responding can set 
up stable avoidance behavior (Baer, 
1960). In the present study, this with- 
drawal technique is used to produce tem- 
porary control of thumbsucking in three 
young children who are persistent thumb- 
suckers. The usual account of thumb- 
sucking attributes it to inner tensions and 
conflicts (Spock, 1959, p. 211), to its self- 
reinforcement consequences (Fenichel, 
1954, p. 63), or to a history of deprivation 
of sucking experience during infancy 
(Roberts, 1944). Palermo (1956) has 
summarized what experimental evidence 
exists, and argued that thumbsucking may 
be interpreted as a learned response which 
reduces anxiety. In this context, it would 
seem valuable to show to what extent 
thumbsucking may be modified by cur- 
rent environmental control, using explicit 
stimulus consequences of the response. 


Procedure 


The first S was a 5-year-old boy from a 
local nursery school, who had seen the 
same three cartoons each session, for eight 
sessions separated from one another by 2 


1 This study was supported by U.S. Pub- 
lic Health Service Grant M-2208. The au- 
thor is grateful to Mrs. Anne Pilisdorf for 
her intelligent and reliable performance 


as A. 
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or 3 days. He showed great enjoyment, 
laughing and mumbling throughout, and 
also sucked his thumb virtually 100% of 
each 2l-min session. During these eight 
preliminary sessions, the subject had seen 
the cartoons without interruption or any 
other experimental treatment. (A bar was 
located close to his right hand for collect- 
ing an extensive operant level; however, 
the operant level of bar pressing was zero 
throughout all of these sessions.) Thus, S 
was well adapted, but experimentally 
naive. 

The general procedure was identical to 
that described in an earlier paper (Baer, 
1960). The S was conducted to the ex- 
perimental room by a young female adult, 
A, who seated him before a movie screen 
built into one wall of the room. She then 
sat behind a partition in a corner of the 
room. Cartoons were projected on the 
screen from the experimenter’s control 
and observation room on the other side of 
the wall. During each of the eight prelimi- 
nary sessions, three 7-min cartoons were 
shown without break or interruption. Dur- 
ing each of the three experimental ses- 
sions reported here, S was shown the same 
three cartoons twice, without any break be- 
tween cartoons, in the sequence A, B, C, 
A, B, C. Thumbsucking was recorded on 
a Gerbrands cumulative recorder which 
stepped one response for every three 
cumulative seconds of thumbsucking. 
Observing through a one-way mirror, the 
experimenter held down a key on an other- 
wise automatic programmer whenever S’s 
thumb was in his mouth. The program- 
mer pulsed the recorder for every 3 sec 
the key was depressed. Under punishment 
conditions, the programmer turned off 
the projector lamp and opened the loud- 
speaker's voice coil as long as the key was 
depressed so that sight and sound of the 
cartoons were withdrawn. 


During the experimental sessions, S was 
shown cartoon A without punishment; 
was punished for all thumbsucking during 
B (a Control period); allowed C as a Re- 
covery period; punished again for all 
thumbsucking during the second (Con- 
trol) showing of A; allowed the second 
showing of B as a Recovery period; and 
punished again for all thumbsucking dur- 
ing the second (Control) showing of C. 


RESULTS AND DISCUSSION 


Cumulative thumbsucking for the three 
experimental sessions is shown in Fig. 1 
(a photographic reproduction of a tracing 
of the original record). The paper speed 
in the recorder was 22 in. per hr; thus, 
maximum slope was not steep. (Note the 
“maximum possible rate” in the figure.) 
During the first showing of A in each ses- 
sion (operant level), the rate of thumb- 
sucking was very nearly maximal. For the 
first session, recovery during C was equal 
to the level established during A, but re- 
covery during the second showing of B 
was less. However, during the second and 
third sessions, recovery was typically 
strong and prompt. The pattern was simi- 
lar for responses under the Control condi- 
tions. During the first session, succeeding 
Control periods were progressively more 
effective in decreasing rate; during the 
second and third sessions, the rate was 
quite uniformly and effectively lowered 
during all Control conditions. 


The S left after seeing only four car- 
toons during the third session, saying he 
had “seen enough.” This may be attrib- 
uted to the periods of punishment under- 
gone. On the other hand, it should be 
recalled that S had seen each cartoon a 
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total of 13 times, at 2- or 3-day intervals: 
satiation is not unreasonable, punishment 
or not. 

The prompt and strong recovery of 
thumbsucking during the Recovery peri- 
ods of the second and third sessions, 
coupled with the immediate weakening 
of the response during Control periods, 
may suggest a rapid process of discrimina- 
tion of the schedule components, rather 
than a generalized suppression of thumb- 
sucking through punishment. At any rate, 
the response remained weak only during 
punishment, a typical enough result. Fur- 
ther experimental manipulation was frus- 
trated by the “graduation” of S from 
nursery school 1 week later. 

The procedure used to establish this 
temporary control of the thumbsucking 
response was a complex one. It involved 
withdrawal of reinforcement; re-presenta- 
tion of reinforcement; and the contin- 
gency of withdrawal for thumbsucking 
and re-presentation for removal of the 
thumb from the mouth. In an attempt to 
show the role of the contingent use of 
these operations, compared with their 
random or noncontingent use, two other 
5-year-old boys were studied in a yoked 
situation, 


FIG. 1. Cumulative thumbsucking curves 
of a single subject under alternating con- 
ditions of Control and Recovery. From 
Baer: Laboratory control of thumbsucking 
by withdrawal and re-presentation of rein- 
forcement. 


In this situation, the two Ss sat side by 
side and watched the same cartoons pro- 
jected on the screen before them. A small 
room-divider was placed between them so 
that they could not observe each other as 
they watched the cartoons. Two observers 
watched the Ss, each recording the thumb- 
sucking of one S on separate cumulative 
recorders.2 (The recorders were housed in 
boxes in a distant room, so that their 
clicking was inaudible to the Ss or Es.) 
The Ss were shown cartoons for a total of 
30 min per session. No experimental pro- 


2 The reliability of the two observers in 
recording thumbsucking was checked by 
having both observers record the thumb- 
sucking of a single S on separate recorders 
during the second of the three preliminary 
sessions. Their records, when superimposed, 
were virtually identical, implying near- 
100% reliability. This technique for assess- 
ing reliability was suggested by Goldia- 
mond (1962). 
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cedures were used in the first three ses- 
sions, because the operant level of thumb- 
sucking in this new situation was found 
to change steadily from uncharacteristi- 
cally low values toward higher rates. By 
the end of the third session, both Ss 
showed stable rates of thumbsucking near 
100%. Two experimental sessions, la- 
belled Session 1 and Session 2 in Fig. 2, 
followed on successive days. In session 1, 
S1 experienced alternating 5-min periods 
of continuous cartoons and contingent 
withdrawal/re-presentation of the car- 
toons. And S82, sitting beside him and 
watching the same screen, hence had a 
yoked withdrawal/re-presentation of the 
cartoons during the same alternate inter- 
vals. However, in his case, these opera- 
tions had only a random contingency with 
his thumbsucking behavior, The next day, 
during Session 2, the roles of S1 and S2 
were reversed: S2 experienced alternating 
periods of continuous cartoons and con- 
tingent withdrawal/re-presentation, while 
S1 experienced the yoked, noncontin- 
gent withdrawal/re-presentation opera- 


tions during the same alternate periods. 

Figure 2 shows the results. (The curves 
are slightly retouched in places where the 
pen left too fine a line for photographic 
reproduction.) In either session, the sub- 
ject undergoing contingent withdrawal/ 
re-presentation of the cartoons for thumb- 
sucking came promptly under the control 
of this contingency. The subject who ex- 
perienced yoked withdrawal/re-presenta- 
tion under the same schedule at the same 
time, but only randomly associated with 
his thumbsucking, showed no obvious ef- 
fect. However, the observer did note a 
transitory exception to this pattern in S1 
during Session 2. In the previous session, 
S1 had been subjected to contingent with- 
drawal/re-presentation for thumbsucking. 


FIG, 2. Cumulative thumbsucking curves 
of two subjects, one experiencing contin- 
gent withdrawal/re-presentation and the 
other ycked, under alternating conditions 
of Control and Recovery. From Baer: 
Laboratory control of thumbsucking by 
withdrawal and re-presentation of rein- 
forcement. 
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When S1 was subjected to a random with- 
drawal/re-presentation of the cartoons 
(yoked to S2) during the first Control 
period of Session 2, he removed his thumb 
from his mouth quite frequently; but he 
replaced it almost immediately each time. 
This operation was closely correlated to 
the withdrawal operations (contingent 
upon the thumbsucking of $2). It did not 
appreciably reduce the amount of cumu- 
lative thumbsucking, and therefore is 
barely discernible in Fig. 2. During subse- 
quent Control periods of Session 2, this 
pattern of response virtually disappeared. 

Hence, contingent withdrawal /re-pres- 
entation of the cartoons appears to 
weaken the thumbsucking response dur- 
ing periods when it is in effect; but ran- 
dom withdrawal/re-presentation opera- 
tions of the same frequency, extent, and 
timing do not appreciably affect a thumb- 
sucking response occurring at the same 
time. 

No claims are made about the gener- 
ality of this effect. The Ss number three; 
all were boys; and all were chosen because 


of their unusually high rate of thumbsuck- 
ing in nursery school settings. Hence, they 
are not a random sample of young thumb- 
suckers. 
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5. 


An Operant-Discrimination Apparatus for Infants** 


Mae Williamson Simmons and 
Lewis P. Lipsitt 


Operant-conditioning and discrimina- 
tion procedures have been used success- 
fully with older children (Warren & 
Brown, 1943; Bijou, 1955; Long, 1959). 
Students of infant behavior have also 
adapted the operant procedure for the 
study of early-learning processes. Brack- 
bill (1958) has conditioned a smiling re- 
sponse in 4-month-old babies, with con- 
tact stimulation as reinforcement; and 
Rheingold, Gewirtz, and Ross (1959) 
trained 3 monthers to vocalize, with audi- 
tory, tactual, and visual components as 
reinforcement. 

This paper describes an operant tech- 
nique that (a) uses manipulanda suitable 
to the response repertoire of infants; (b) 
provides a choice situation to enable the 
study of discriminative behavior; and (c) 
allows automatic recording of response 
frequency to different stimuli within time 
units. 

Figure 1 is a [drawing] of the apparatus. 


* From M. W. Simmons and L. P. Lipsitt, 
An operant-discrimination apparatus for in- 
fants, J. exp. anal. Behav., 4, 233-235 
(1961). Reprinted by permission of the 
authors and the Journal of the Experi- 
mental Analysis of Behavior. 


It consists of two units: one contains the 
stimuli, manipulanda, and auditory-rein- 
forcement sources; and the other con- 
tains the experimenter’s remote-control 
switches. The child’s unit is a rectangular 
box, shaped so that it rests on the play- 
pen floor with the front panel sloping 
toward S. Two 6-inch white square insets 
are the manipulanda. In the center of 
each square is a 2-inch-diameter aperture 
of flashed opal glass; and behind each of 
these is a cluster of four colored (red, 
pink, blue, and yellow) bulbs, each ac- 
tivated independently. The manipulanda 
rest on microswitch leafs which allow 
them to be moved about 0.5 inch when 
tapped or banged. When a panel is 
moved, either the sound of chimes or no 
sound will occur, depending on the set- 
ting made by E at the remote unit, from 
which the stimulus lights are also con- 
trolled. From counters, E reads the cumu- 
lative frequency of responding to each 
panel every 30 seconds. 

Data from two infants are reported 
here to exemplify the procedures used. 


1 The development of this technique has 
been supported by the Institute for Health 
Sciences at Brown University, under a 
Public Health Service research grant 
(B-2356) from the National Institute of 
Neurological Diseases and Blindness. The 
writers are indebted to Dr. Glidden L. 
Brooks, Director of the Institute for Health 
Sciences, for his encouragement. Mr. 
Clement DeLucia constructed the appa- 
ratus. 
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Each experimental session lasted 8 min- 
utes, divided into four 2-minute phases. 
In Phase 1, the positive stimulus (e.g., 
red light and chimes) occurs in the left 
panel, while the negative stimulus (e.g., 
blue light and no sound) occurs in the 
right. In Phase 2, the positive stimulus is 
switched to the right panel and the nega- 
tive stimulus to the left panel. In Phase 
3, both panels are negative; thus, a re- 
sponse to either panel produces no sound. 
In Phase 4, the positive stimulus is again 
associated with one of the panels and the 
negative stimulus with the other. 

Figure 2 shows the data from one in- 
fant in a red-positive, blue-negative dis- 
crimination setting. The same data are 
plotted in two ways. The top graph is a 
continuous recording of responses to the 
left and right panels. In Phase 1, the child 
pushed the left positive panel with a 
greater frequency than the right negative 
panel. In Phase 2, where red and chimes 


FIG. 1. The apparatus. From Simmons 
and Lipsitt: An operant-discrimination 
apparatus for infants. 


were switched to the opposite panel, the 
child’s relative frequency of responding 
to the two panels switched accordingly. 
In Phase 3, an extinction phase in which 
both panels are negative, the child tended 
to stop responding, particularly in the sec- 
ond minute of the interval. In Phase 4, a 
pattern of discriminative responding was 
restored, with almost no responses occur- 
ting to the negative panel. The bottom 
graph shows the same data, resetting the 
frequency curves at zero in each new 
phase. The data from the next subject are 
plotted in this manner in Fig. 3. 

Figure 3 shows the data from another 
infant tested on two occasions separated 
by 3 days. On the first occasion, the dis- 
crimination was a red-positive, pink-nega- 
tive one; on the second day, pink was 
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FIG. 2. Cumulative-frequency curves to 
the two panels from a 10-month-old girl. 
The data in the bottom graph are replots 
of the data above. From Simmons and 
Lipsitt: An operant-discrimination appa- 
ratus for infants. 


associated with chimes and red was the 
negative stimulus. On the first day, the 
discrimination was readily established in 
Phase 1, and in Phase 2 the infant’s be- 
havior shifted appropriately. In Phase 3, 
this child produced more responses than 
in any other phase. This may represent an 
initial frustration reaction produced by 
the withdrawal of the previously positive 
stimulation. However, this reaction was 
short-lived and extinction behavior en- 
sued. Responses decreased greatly in the 
second minute of that phase relative to 
the first. The bottom part of Fig. 3 shows 
the second session, in which pink was 
now the positive stimulus. In the first 
two phases, discriminative behavior was 
present but it was not so striking as on 
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from a 12-month-old boy on two different 
occasions. The positive stimulus was red 
on the first occasion and pink on the next. 
From Simmons and Lipsitt: An operant- 
discrimination apparatus for infants. 


the first day; by the fourth phase, differ- 
ential responding was clearly present. 

The procedures described here offer a 
technique for the study of learning and 
discrimination processes in the human in- 
fant. Variations of these procedures may 
be used to assess the sensory capacities of 
the young child who is unable to verbally 
report perceived differences in paired 
stimuli. 
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6. 


Vicarious Reinforcement and Imitative Learning*’ 


Albert Bandura, Dorothea Ross,” 
and Sheila A. Ross 


lhe present experiment was designed to 
study the influence of response-conse- 
quences to the model on the imitative 
learning of aggression. Nursery school chil- 
dren were assigned randomly to 1 of the 
following groups: aggressive model-rewarded; 
aggressive model-punished; a control group 
shown highly expressive but nonaggressive 
models; and a 2nd control group which had 
no exposure to models. The children were 
then tested for the incidence of post-expo- 
sure imitative and nonimitative aggressive 
responses. Children who witnessed the ag- 


* From A. Bandura, D. Ross, and S. A. 
Ross, Vicarious reinforcement and imita- 
tive learning, mimeographed paper, 1962. 
Reprinted by permission of the authors. 

1 This investigation was supported by 
Research Grant M-5162 from the National 
Institutes of Health, United States Public 
Health Service. The authors wish to thank 
William Yabroff for his assistance with the 
photography, Jeffrey Eiseman and Joe 
Leonard for serving as models, and Marilyn 
Haley for her aid in arranging the research 
facilities. 


gressive model rewarded showed more imi- 
tative aggression and preferred to emulate 
the successful aggressor than children in the 
aggressive model-punished group who both 
failed to reproduce his behavior and rejected 
him as a model for emulation. Control over 
aggression was vicariously transmitted to 
boys by the administration of aversive stim- 
uli to the model, and to girls by the presen- 
tation of incompatible prosocial examples 
of behavior. 


It is becoming increasingly apparent 
that social learning cannot be adequately 
explained in terms of direct reinforce- 
ment principles. New social responses 
may be acquired or the characteristics of 
existing response hierarchies may be con- 
siderably modified as a function of ob- 
serving the behavior of others and its 
response consequences without the ob- 
server's performing any overt responses 
himself or receiving any direct reinforce- 
ment during the acquisition period (Ban- 
dura, 1962). The amount of learning ex- 
hibited by the observer can, in fact, be as 
great as that shown by the reinforced 


2 This Research was carried out while 
the junior author was the recipient of an 
American Association of University 
Women International Fellowship for post- 
doctoral research. 
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performer (McBrearty, Marston, & Kan- 
fer, 1961). The study reported in this 
paper is one in a series of experiments of 
learning through imitation designed to 
bring a wider range of social learning 
phenomena within the scope of behavior 
theory. 

It is a common assumption in theoriz- 
ing about vicarious or imitative learning 
that this mode of response acquisition is 
based essentially on a process of covert 
instrumental conditioning in which the 
observer acquires responses imitatively by 
performing covertly the behavior exhib- 
ited by a model (Logan, Olmstead, Ros- 
ner, Schwartz, & Stevens, 1955; Maccoby, 
1959). It is further assumed that the 
occurrence of vicarious learning phenom- 
ena is contingent on the administration 
to the performing model reinforcing stim- 
uli which the observer presumably experi- 
ences as vicarious reinforcements (Hill, 
1960; Mowrer, 1960). Some evidence that 
direct and vicarious reinforcement may, 
in fact, function analogously is provided 
by studies demonstrating that when a 
model is punished in the presence of an 
observer, the latter acquires conditioned 
emotional responses even though he him- 
self receives no aversive stimulation (Bar- 
nett & Benedetti, 1960; Berger, 1962; 
Haner & Whitney, 1960), and that vicari- 
ously conditioned fear responses mediate 
avoidance reactions or response inhibition 
(Walters, Leat, & Mezei, 1963). Simi- 
larly, observation of a model performing 
responses for which he is positively rein- 
forced may be expected to produce disin- 
hibition, and positive incentive learning 
in the observer, thus facilitating the oc- 
currence of imitative behavior (Bandura 
& Walters, 1963; Mowrer, 1960). In order 
to test systematically the possible influ- 
ence of vicarious reinforcement on imita- 
tive learning, an experiment was con- 


ducted in which imitation of aggression 
was studied as a function of rewarding 
and punishing consequences to the model. 

Nursery school children were randomly 
assigned to one of the following groups: 
aggressive model-rewarded, aggressive 
model-punished, a control group shown 
highly expressive but nonaggressive mod- 
els, and a second control group which had 
no exposure to the models. In accordance 
with the theory of vicarious reinforce- 
ment, it was predicted that children who 
observe a model amass highly desired re- 
inforcers through aggressive behavior will 
display more imitative and nonimitative 
aggression than children who see the 
model punished for exhibiting aggressive 
responses. Evidence that mere exposure 
to aggressive models augments an ob- 
server's expression of aggression (Bandura, 
Ross, & Ross, 1961, 1963; Lévaas, 1961; 
Mussen & Rutherford, 1961; Walters, 
Llewellyn-Thomas, & Acker, 1962), sug- 
gests that the model-punished condition 
is likely to produce both eliciting and in- 
hibitory effects and consequently, the 
outcome will be partly a function of 
which of the two effects predominate. 
Since, however, the model was admin- 
istered relatively severe physical punish- 
ment, it was predicted that the model- 
punished group will display less nonimi- 
tative aggression and no more imitative 
aggressive responses than the control 
group children who had no exposure to 
aggressive models. 


Method 
SuBJECTS 


The subjects were 40 boys and 40 girls 
drawn from the Stanford University Nurs- 
ery School. They ranged from 38 to 63 
months, with a mean age of 51 months. 
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The boys and girls were randomly as- 
signed to one of the two experimental or 
control groups. The models were two 
adult males presented to the children by 
means of 5-minute film sequences pro- 
jected on a glass lenscreen in a television 
console. 


PROCEDURE 


The experimenter met the child in the 
nursery school and invited him to play in 
her toy room. On the way to the room the 
experimenter informed the child that first 
she had to complete some paper work in 
another office during which time the child 
could watch a televised program. As they 
entered the office the experimenter seated 
the child and then ostensibly tuned in a 
program on the television console situated 
approximately 5 feet directly in front of 
the child. The experimenter occupied her- 
self busily in a far corner of the room 
while the child viewed the filmed per- 
formance, 

In the Aggressive Model-Rewarded con- 
dition, Rocky, the aggressive model, en- 
counters Johnny who is playing with his 
highly attractive collection of toys. Rocky 
asks to play with some of the articles but 
is refused, He then exhibits the following 
sequence of aggressive responses: he 
strikes Johnny several times with a rubber 
ball; he kicks an inflated plastic doll about 
the room; and shoots darts at Johnny's 
cars and plastic farm animals. Following 
this display of aggression, Rocky stumbles 
as he steps over a pile of toys, Johnny sits 
on him and attempts to spank him but is 
quickly overpowered. Rocky then strikes 
Johnny with a baton, lassoes him with a 
hoola hoop, and pulls him forcefully to a 
far corner of the room. Throughout the 
filmed interaction, Rocky’s aggressive acts 
were accompanied by numerous distinc- 


tive aggressive verbalizations. The final 
scene shows Johnny seated dejectedly in 
the corner while Rocky is playing with the 
toys, serving himself generous helpings of 
7-Up and cookies, and riding a large 
bouncing hobby horse with gusto. As the 
scene closes, Rocky packs the playthings 
in a sack and sings a merry tune, “Hi ho, 
hi ho, it’s off to play I go,” as he departs 
with the hobby horse under his arm and 
the bulging sack of loot over his shoulder. 
A commentators voice announces that 
Rocky is the victor. 

The film shown to the children in the 
Aggressive Model-Punished condition was 
identical in all respects with the one pre- 
sented to the model-rewarded group ex- 
cept that the social-interaction sequence 
was slightly rearranged so that the aggres- 
sive behavior shown by the model resulted 
in his being severely punished. The scene 
in which Johnny attempts to spank Rocky 
was inserted at the end of the film and 
extended so that Rocky is thoroughly 
thrashed by Johnny. As soon as he suc- 
ceeds in freeing himself, Rocky flees to a 
corner of the room where he sits cower- 
ing, while Johnny places his toys in the 
sack and walks away. The announcer com- 
ments on Rocky’s punishment. 

Children in the Nonaggressive Model- 
Control group observed the two males 
engage in vigorous but nonaggressive play 
with the aggressive stimulus objects. Since 
observation of models playing actively 
with particular articles may reduce inhibi- 
tory responses and enhance the observer's 
interest in the same or similar stimulus 
objects, this control group provided a par- 
tial check on the influence of activity level 
and the stimulus enhancement factor 
(Crawford & Spence, 1939), on the per- 
formance of aggressive responses. The 
models in the control film threw the ball 
to each other by bouncing it off the wall; 
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they used the guns as a low hurdle in a 
jump game; they danced with the plastic 
doll, and rolled and twirled the baton and 
hoola hoop. 

Children in the second control group 
had no prior exposure to models. 


Test ror DELAYED [MITATION 


After observing the models, the chil- 
dren were tested in a different experimen- 
tal situation designed to assess the inci- 
dence of post-exposure imitative and 
nonimitative aggressive responses. The ex- 
perimental test room contained a baton, 
two 5-foot Bobo dolls, three balls, a hoola 
hoop, and a lasso, dart guns, cars, and 
plastic farm animals, all of which could 
be used by the children to reproduce the 
models’ aggressive response patterns. A 
variety of toys which tend to elicit pre- 
dominantly nonaggressive responses were 
also provided. These included a black- 
board, a doll house equipped with furni- 
ture and a doll family, three cotton-stuffed 
dolls, and a set of building blocks. In 
order to control for any variation in be- 
havior due to position of the stimulus ob- 
jects in the room, the play material was 
arranged in a fixed order for each of the 
test sessions. It was necessary for the ex- 
perimenter to remain in the room during 
the experimental session since the pretest 
revealed that the children exhibited some 
anxiety about being left alone in the room 
for a relatively long period of time and 
tended to leave before the termination of 
the session. However, the experimenter 
minimized any influence that her presence 
might have on the children’s behavior by 
busying herself with paper work at a desk 
in the far corner with her back turned to 
the room and thereby avoided any inter- 
action with the children. 

Each child spent 20 minutes in the test 


room during which time his behavior was 
rated in terms of predetermined response 
categories by judges who observed the 
session through a one-way mirror in an 
adjoining observation room. The 20-min- 
ute session was subdivided into 5-second 
intervals by means of an electric timer, 
thus yielding a total number of 240 re- 
sponse units for each child. 

One rater scored the test sessions for all 
80 children. In order to provide an esti- 
mate of interscorer reliability, the re- 
sponses of 11 children were scored inde- 
pendently by a second observer. Neither 
of the raters had knowledge of the treat- 
ment conditions to which the children 
were assigned. Since the raters simply re- 
corded the frequency of occurrence of 
clearly defined specific classes of re- 
sponses, interscorer reliabilities were high, 
the product-moment coefficients being in 
the .90s. 


Response MEASURES 


The measure of imitative aggression 
was obtained by counting the frequency 
with which the child performed the fol- 
lowing matching responses: kicks the 
Bobo doll, lassoes it or strikes it with a 
ball or the baton, shoots darts at the cars 
or plastic farm animals; repeats the spe- 
cific aggressive verbal responses emitted 
by the model. . . . 


MODEL PREFERENCE 


At the conclusion of the experiment 
each child who participated in treatment 
conditions utilizing models, was asked to 
evaluate the behavior exhibited by Rocky 
and Johnny, and to select the characters 
he preferred to emulate. The children’s 
preferences for the two models served as 
an additional measure of the influence of 
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response-consequences to the model in 
promoting imitation. 


Results 


The mean aggression scores for children 
in the experimental and the control 
groups are presented in Table 1. Since 
many of the children, particularly the 


girls, in the two control groups received 
zero or very low imitation scores, non- 
parametric techniques were employed to 
evaluate the significance of the obtained 
differences. Results of the Kruskal-Wallis 
analysis of variance performed on these 
scores reveal that imitation is significantly 
influenced by response-consequences to 
the model (Table 2). Further comparison 


TABLE 1 
Mean Aggression Scores for Children in the 
Experimental and Control Groups 


EXPERIMENTAL GROUPS 


CONTROL GROUPS 


Aggressive Aggressive Non- No 
Response category model- model- aggressive model 
rewarded punished model 
Imitative aggression 15.4 8.4 Ted 53 
boys 16.2 7.8 10.0 5.6 
girls 14.5 8.9 A4 49 
Nonimitative aggression 59.9 45.2 59.2 56.6 
boys 75.6 45.6 81.7 62.0 
girls 44.1 44.7 36.7 51.2 
Total aggression 75.2 53.5 66.4 61.8 
boys 91.8 53.4 917 67.6 
girls 58.6 53.6 41.1 56.1 


From Bandura, Ross and Ross: Vicarious reinforcement and imitative learning. 


TABLE 2 
Significance of the Differences between Experimental and 
Control Groups in Imitative Responses 


COMPARISON OF PAIRS OF TREATMENT CONDITIONS 


Nonag- 
R Rewarded Rewarded Rewarded Punished Punished gressive 
wees p versus versus versus versus versus versus 
ceog punished nonaggressive control nonaggressive control control 
P iz P. P P P 
seen, 9:69 <05 <05  <0235 <.001 ns nso ons 
gression 


————— eee 


From Bandura, Ross and Ross: Vicarious reinforcement and imitative learning. 
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of pairs of scores by the Mann-Whitney U 
test, show that children who observed the 
mode! amass rewards through aggression 
displayed significantly more imitative ag- 
gressive behavior than did children in the 
other three groups which did not differ 
from each other in this respect (‘Table 2). 

Not only were the children more in- 
clined to reproduce the behavior of the 
rewarded model, but they also preferred 


to emulate the aggressive model more fre- 
quently when he secured attractive re- 
wards through physical aggression, than 
when he was punished for displaying the 
same behavior, or was simply permitted 
access to the rewarding resources and be- 
haved in a prosocial manner (Table 3). A 
chi square analysis of these data provided 
a value of 19.85 which is significant be- 
yond the .001 level. Although several of 


TABLE 3 
Percentage of Children in the Model Rewarded, Model Punished, and 
Nonaggressive Model Groups Selecting Rocky or Johnny as 
Objects of Imitation 
Deen eee me 


AGGRESSIVE AGGRESSIVE 
NONAGGRESSIVE 
CHOICE OF MODEL MODEL- MODEL- 
MODEL 
REWARDED PUNISHED 
E O E a 
Rocky 60 20 0 
Johnny 5 20 30 
No preference 35 60 70 


From Bandura, Ross and Ross: Vicarious reinforcement and imitative learning. 


the expected theoretical frequencies were 
less than 5, the extremely high signifi- 
cance level adds to the reliability of these 
findings. . . . 


DISCUSSION 


The results of the present study provide 
support for the hypothesis that imitation 
is partly dependent on response-conse- 
quences to the model. Children who wit- 
nessed the Aggressive Model-Rewarded 
showed more imitative aggression and pre- 
ferred to emulate the successful aggressor 
than children in the Aggressive Model- 
Punished group who both failed to repro- 
duce his behavior and rejected him as a 
model for emulation. . . . 
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Deprivation and Satiation of Social 
Reinforcers as Drive Conditions* 


Jacob L. Gewirtz' and Donald M. Baer? 


*From J. L. Gewirtz and D. J. Baer, 
Deprivation and satiation of social rein- 
forcers as drive conditions, J. abnorm. Soc. 
Psychol., 57, 165-172 (1958). Reprinted 
by permission of the authors and the 
American Psychological Association. 


1 This study was carried out when the 
senior author was on the faculty of the 
University of Chicago, and was facilitated 
by a grant given to him by the Social 
Science Research Committee of that insti- 
tution. The writers acknowledge with grati- 
tude the discriminating assistance of Chaya 
H. Roth. 


In an earlier study (6) we received 
what appeared to be an affirmative answer 
to the question: Are there social drives 
that respond to reinforcer deprivation as 
do the primary appetitive drives? In this 
investigation we extend the question, ask- 
ing in addition if the behaviors main- 
tained by social reinforcers are responsive 
also to a condition of relative satiation for 


2 At the time of this study, the junior 
author was a Public Health Service Pre- 
doctoral Research Fellow of the National 
Institute of Mental Health at the Uni- 
versity of Chicago. 
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such reinforcers. Children are again em- 
ployed as subjects (Ss). 

In the earlier study it was found that 
when an adult made words and phrases 
like “Good!” and “Mm-hmm” contin- 
gent upon an arbitrarily chosen response 
in nursery school children, that response 
was reinforced (i.e, conditioned). This 
effect was similar to that found in several 
other studies using verbal stimuli appeal- 
ing to the concept of approval as rein- 
forcers (e.g., 2, 9, 12, 16). It was found, 
in addition, that this reinforcing effect of 
approval could be increased when the 
children experienced a preceding 20-min- 
ute period of social isolation, relative to 
its effectiveness for the same children 
when they had not been isolated. While 
this result held primarily for boys tested 
by a female (rather than male) experi- 
menter, other aspects of the data clearly 
supported the equating of isolation to the 
deprivation of social reinforcers: social 
isolation increased reliably the reinforcing 
power of adult approval for children as a 
positive function of the degree to which 
they typically sought such approval in 
other settings. Approval was taken to be 
representative of the reinforcers which 
control the purely social initiations made 
by children to adults. 

Deprivation implies a period of un- 
availability of a given reinforcer, which 
results in an increase in behaviors for it; 
satiation implies a period of availability 
of a reinforcer, sufficient to effect a de- 
crease in behaviors for it. Thus, depriva- 
tion and satiation represent two state- 
ments of a single concept, a dimension 
characterized by the relative supply of a 
reinforcer in the recent history of an or- 
ganism which determines the incidence 
of behaviors for that reinforcer. The con- 
cept of deprivation-satiation has consid- 


erable precedent as a drive operation in 
general behavior theory (eg. 11, 14), 
where it has been employed to order con- 
temporary conditions which account for 
variance in reinforcer effectiveness. As 
such, drive is generally defined as the 
functional relation between deprivation 
(or satiation) for a reinforcer and re- 
sponding for that reinforcer. Further, 
concepts like deprivation have been some- 
what loosely applied in a number of spec- 
ulative formulations of the antecedents 
of certain social behaviors (e.g., 1, 8, 13, 
15). Hence, laws relating social depriva- 
tion as an empirically defined dimension 
to certain basic characteristics of social be- 
haviors would have considerable integra- 
tive value (5). But first, the experimental 
operations of deprivation and its inverse, 
satiation, must be implemented effec- 
tively in social terms. 

In the earlier study cited (6), a begin- 
ning attempt was made to implement 
social deprivation: brief social isolation 
of a child was equated to a condition of 
deprivation of all social reinforcers (in- 
cluding approval), and the differential 
effects of that condition and of a com- 
parison nonisolation (nondeprivation ) 
condition were reflected in the reinforc- 
ing effectiveness of an adult’s approval. 
The present study represents an attempt 
to simplify (and replicate) the social 
deprivation operation of the earlier study, 
as well as a beginning in the direction of 
establishing an operation of social satia- 
tion. Satiation will be equated to a condi- 
tion in which an abundance of approval 
and social contact is supplied to a child 
by an adult, Experimental operations im- 
plementing the conditions of deprivation 
and of satiation for a class of social rein- 
forcers are both reflected against an inter- 
mediate or nondeprivation (nonsatiated) 
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condition. The hypothesis is that these 
conditions should enhance the effective- 
ness of the reinforcer in the order: Dep- 
rivation > Nondeprivation > Satiation. 


Method 


SAMPLE 


The Ss were 102 middle-class children 
selected from the classes of the first and 
second grades of a university laboratory 
school and randomly assigned to experi- 
mental conditions. Sixteen were Negro, 
the remainder white. Their mean age at 
the time of testing was seven years, six 
months, with a range from six and one- 
half to nine years. Their mean and 
median Stanford-Binet IQ score was 127 
(the scores of only 3 Ss were below 100). 
One-half of the Ss under each condition 
were girls and one-half boys. The Ss were 
selected by their teachers according to the 
order in which their names appeared on 
alphabetical class lists. No S refused to 
participate, 


INDEPENDENT VARIABLE 


Deprivation 


Seventeen boys and 17 girls were sub- 
jected to a condition of social isolation 
before playing the game. Each of these 
Ss was introduced to the experimenter 
(E) in the classroom by the teacher. 
The E was a young woman in her early 
twenties. She walked with S a distance 
of several hundred feet through the 
school corridors to the experimental 
room. During this walk, E responded to 


3 This E served as one of the two Es in a 
companion study (6). 


S’s questions and comments only when 
necessary, and maintained a somewhat dis- 
tant but not unfriendly manner at all 
times. Upon reaching the experimental 
room, E showed S around the room, 
seated him and told him that someone 
else was using the game which he was to 
play and that she would have to fetch it 
but would be back in a little while. E 
then left the room and went (unob- 
served) to an adjacent observation booth 
from which S was observed during his iso- 
lation. She returned after 20 minutes with 
the toy. The game was then played in the 
usual fashion. The Ss, who occasionally 
accompanied adults in the school setting 
for tests, and who had experience in await- 
ing their turns, all accepted this condition 
without question. 


Nondeprivation 


Seventeen boys and 17 girls were 
subjected to a condition of nonisolation, 
i.e., they played the game immediately 
upon their arrival at the experimen- 
tal room. (Since this condition repre- 
sents both relative nondeprivation and rel- 
ative nonsatiation for approval, it served 
as an intermediate control condition for 
the other two conditions.) Until they 
entered the experimental room, Ss in this 
group were treated identically as were Ss 
in the Deprivation group. 


Satiation 

Seventeen boys and 17 girls were sub- 
jected to a condition of relative satiation 
for approval from the adult before play- 
ing the game. Again, each of these Ss 
was introduced to E in the classroom 
by the teacher, but during the walk 
to the experimental room, E maintained 
a very pleasant and interested attitude to- 
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ward S, responding to all details of his 
comments and questions, asking ques- 
tions to draw out more of S’s conversa- 
tion, and generally approving of anything 
about S which might reasonably be 
praised or admired. Upon reaching the 
experimental room, E showed S around 
the room, seated him, told him that the 
game was in use elsewhere and that she 
would go fetch it in a little while when it 
would be free. She suggested that mean- 
while S might like to draw pictures or cut 
out designs, and proffered the essential 
materials. Then, for 20 minutes S drew or 
cut out designs, while E maintained a 
stream of friendly conversation with him, 
inducing him to talk about himself if he 
did not do so naturally. The E alternated 
her praise and admiration of whatever S 
did with whatever he said about himself, 
all in an appropriate fashion, and at- 
tempted to dispense 30 such reinforcers 
during the 20-minute satiation period at 
an approximate rate of three every two 
minutes. In fact, E dispensed to the boys 
an average of 31.6 such reinforcers (o = 
6.9) and to the girls an average of 28,2 
reinforcers (o = 8.1). 


Tue Game SETTING 


Following the experimental treatment, 
the central task for S (which was the 
same for all three groups) was to place 
marbles into either of the two holes of the 
toy (shown in Fig. 1) while E, who sat 
beside him, looked on. (This procedure 
was identical to that employed in the 
earlier study (6) and is only summarized 
here.) The E observed S’s play for a 
“baseline” period of four minutes, during 
which no reinforcers were dispensed. 
Meanwhile, E responded to any of S’s 


FIG. 1. A schematic diagram of the ex- 
perimental apparatus (the “game”). From 
Gewirtz and Baer: Deprivation and sati- 
ation of social reinforcers as drive con- 
ditions. 


comments and questions in a friendly but 
brief manner. Without pause, the base- 
line period was followed by a 10-minute 
test of reinforcer effectiveness. That is, E 
proceeded at this point to dispense the 
reinforcer, consisting of words like 
“Good,” “Hm-hmm,” and “Fine,” ac- 
cording to a schedule incorporating sev- 
eral, successively higher, fixed ratios, 
whenever S dropped marbles into the 
correct hole, defined as that preferred least 
during the last (fourth) minute of the 
baseline period. 


DEPENDENT VARIABLES 


Reinforcer effectiveness score 


The determination of the effectiveness 
of approval as a reinforcer was made from 
the “game” which followed immediately 
the treatment condition (i.e., the 20 min- 
utes of Deprivation or of Satiation, or in 
the Nondeprivation condition, the arrival 
at the experimental room). The basic data 
were the numbers of marbles dropped in 
the correct and incorrect holes during 
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each minute of play. These generated four 
pairs of frequency scores for the baseline 
period, and 10 such pairs of scores for the 
reinforcer effectiveness test period. For 
each minute of play, the relative fre- 
quency of a correct response was the ratio 
of correct responses to total responses, 
ie, # correct/(# correct + # incor- 
rect). The score employed as dependent 
variable was taken as the difference, for 
each S, between the relative frequency of 
correct responses in the last (fourth) min- 
ute of the baseline period (when no rein- 
forcers were dispensed) and the median 
relative frequency of correct responses of 
the 10 reinforcer test period minutes. This 
reinforcer effectiveness score represents 
the gain in relative frequency of the cor- 
rect response attributable to the social 
reinforcer provided by the adults ap- 
proval. 


Spontaneous social initiations 


In addition, the verbal and purely social 
initiations of the child to the adult were 
tallied, but only during the baseline pe- 
tiod of the game, before she began to 
dispense approval. The E treated the 
game as S’s central task and, while per- 
missive, generally discouraged lengthy 
initiations on the part of S, suggesting, 
when necessary, that they could converse 
at length after the game. Where a reply 
to an initiation of S was required, E’s re- 
sponse was always friendly, yet brief, leav- 
ing responsibility for continuing that in- 
teraction sequence in S’s hands. All such 
responses by S were tallied by an observer 
in an observation booth, These responses 
took the form most frequently of Com- 
ments, less frequently of Questions, and 
least frequently of overt Attention-seek- 
ing. They could be expected to represent 


behaviors by S for a variety of social rein- 
forcers, in addition to approval. Com- 
ments were casual remarks which usually 
required no formal response from E (e.g., 
“Were going away for the holiday”). 
Questions, which were also casual, re- 
quired only brief, token replies from E 
(eg. “Do you think it will rain?”). 
When making a comment or asking a 
question, S typically continued respond- 
ing in the game. Attention-seeking in- 
cluded responses characterized by urgency 
designed for active notice from E. Typi- 
cally, S would pause to direct his com- 
plete attention to E while awaiting a re- 
sponse (e.g., “Watch me put the marble 
into this hole!”). Because of their gen- 
erally infrequent occurrence in this study, 
these three behavior categories are scored 
in two different ways to produce two rela- 
tively independent response indices for 
the purpose of analysis: 

a. The sum of the frequencies in the 
three social response categories, Com- 
ments, Questions, and Attention-seeking, 
which weights those categories in propor- 
tion to their frequency of occurrence 
(i.e, Comments contributes most and 
Attention-seeking least to that index). 

b. The score of a cumulative Guttman- 
like scale (10), indexing what appears to 


4 These three observation categories are 
defined in detail in (3). High agreement 
between observers was found there on these 
behavior categories, and they entered into 
similar patterns of relationship with the 
independent variables. Moreover, they were 
found in (4) to have high loadings on a 
single factor and appeared to involve an ac- 
tive attempt to gain or to maintain the 
adult’s attention, perhaps differing in the 
degree to which their initiations for atten- 
tion were overt or direct. 
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be the intensity of social contact, formed 
similarly as in (3) when the frequency 
scores for each verbal response category 
were dichotomized for each S into gross 
response alternatives, zero or nonzero fre- 
quency of occurrence.’ A scale score of 3 
indicated that an S had exhibited some 
of all three behaviors; a score of 2 indi- 
cated that some Comments and Ques- 
tions were exhibited, but no Attention- 
seeking; a score of 1 indicated that only 
Comments were exhibited; and a score of 
zero indicated that no social response of 
any type was exhibited. Hence, the scale 
scores are weighted in favor of the less 
frequently occurring behavior categories, 
Questions and Attention-seeking. 


Results 


The hypothesis advanced is that the 
mean reinforcer effectiveness scores for 
the treatment groups would rank in the 
order Deprivation > Nondeprivation > 


5 Of all 102 Ss in the four-minute base- 
line period, the proportion showing non- 
zero category frequencies was .71 for Com- 
ments, .53 for Questions, and .15 for 
Attention-seeking. When the response 
categories were arranged in the order of 
their decreasing popularities (the propor- 
tion of Ss exhibiting nonzero frequencies), 
it was concluded that, for present purposes, 
a satisfactory three-item Guttman-like scale 
was produced: only .03 of the 306 re- 
sponses produced scale errors, the few scale 
errors found appeared random, and every 
observation category contained far less error 
than nonerror. Of the 68 Ss in the Dep- 
rivation and Nondeprivation groups, five 
each produced one scale error in his re- 
sponse pattern. Such response patterns 
were assigned scale scores corresponding to 
the higher pattern which would have been 
attained had there been no scale error. 


Satiation. To test this, two relatively inde- 
pendent statistical procedures are fol- 
lowed: the first is sensitive to the rank- 
order of the treatment means but does 
not take account of the degree of overlap 
between the distributions upon which the 
means are based; and the second, which 
takes such information into account and 
allows parametric statements about the 
means, is somewhat less sensitive to the 
tank-order hypothesis. 


REINFORCER EFFECTIVENESS SCORE 


Rank-order of the means 


In Table 1, it is seen that the rank-order 
predicted for the three means is found 
separately for Boys and for Girls. The sex 
variable may be taken as an independent 
replication of the experiment. The theo- 
retical probability of obtaining a predicted 
rank-order of three independent means is 
¥, and with one independent replication 
the probability of obtaining two such 
orders is % x ¥% or 146. On this basis, we 
can conclude that the null hypothesis, 
that all six rank-orders of the three means 
are equally likely, is rejected at p < .03. 
Hence, the alternative hypothesis, that 
the predicted rank-order of the three 
means prevails, is accepted. 


Regression analysis 


For the purposes of the regression analy- 
sis (and for theoretical reasons as well), 
the three treatment conditions are con- 
sidered as points along a single continu- 
ous dimension representing the degree of 
social deprivation. The analysis then 
proceeds from three working assump- 
tions: (a) the units separating the treat- 
ments along this deprivation dimension 
are roughly equal in size, (b) their re- 
lationship to the reinforcer effectiveness 
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TABLE 1 


Table of Means 
——— naa a r a B a a a aoh e 


DEPRIVATION SATIATION NON- 
SEX 

(D) (s) 2D. S) DEPRIVATION 
Boys ELY .18* Tifa 2h 
Girls bh 07" «20** 230 
Combined 1343s Ade arse one 


* 17 cases; S.E, of a mean difference is .068. 
** 34 cases; S.E. of a mean difference is .048. 


*** 68 cases. 


From Gewirtz and Baer: Deprivation and satiation of social reinforcers as drive 


conditions. 


means is linear, and (c) it is the pattern 
of the three means that is relevant to the 
rank-order hypothesis advanced, not the 
contrasts between mean pairs representing 
adjacent points on the postulated treat- 
ment dimension. On this basis, it appears 
most efficient to carry out the analysis of 
variance according to a regression model: 
in essence, to analyze the regression of the 
reinforcer effectiveness score means on 
the treatment dimension. 

The reinforcer effectiveness scores of 
the Ss were classified in the six cells of a 
3 x 2 factorial, there being three treat- 
ments and two sexes of Ss. After a Bartlett 
test indicated that the variances were 
homogeneous and an examination of the 
data suggested that the other assumptions 
underlying the analysis appeared to hold, 
the data were subjected to an analysis of 
variance. Table 2 indicates that there is 
no over-all sex difference, and that the 
treatment conditions do not affect the sex 
groups differentially. From Fig. 2, it is 
seen that the group means corresponding 
to the three levels of the experimental 
variable rank-order according to the hy- 
pothesis. It is seen in Table 2 that the 
Deprivation vs. Satiation comparison is 


reliable and in the order predicted. In the 
case of three means, this comparison rep- 
resents the regression of those means on 
the treatment dimension. A Nondepriva- 
tion vs. % (Deprivation + Satiation) 
comparison, which represents the devia- 
tion of the Nondeprivation mean from 
the regression line, indicates that that 
mean falls remarkably close to the regres- 
sion line. Hence, the regression predicted 
was found. (This result provides presump- 
tive evidence only for the effectiveness of 
either of the extreme treatments, Depriva- 
tion or Satiation, relative to the inter- 
mediate Nondeprivation treatment.) 


Approval as a reinforcer 


A question of interest is whether the re- 
inforcer dispensed was effective as such 
under Nondeprivation, which would be 
comparable to the usual experimental case 
under which the effectiveness of the rein- 
forcer would be examined, as well as fol- 
lowing Satiation, when the reinforcer was 
relatively least effective in this experiment. 
The hypothesis is tested that the mean 
reinforcer effectiveness score under Non- 
deprivation is zero, employing an error 
term based only upon those 34 scores and 
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TABLE 2 
Summary of the Analysis of Variance of the Reinforcer Effectiveness Score 


SOURCE OF VARIATION df ae F 
SQUARE 
Boys vs. Girls (Sex) 1 0412 524 
Treatments 
total (2) (.4032) (5.123*) 
deprivation (D) vs. 1 8031 10.200** 
satiation (S)*® 
nondeprivation (N) 1 0034 043 
vs. Ya (D+S)> 
Sex X Treatment interaction 
total (2) (.0356) (.452) 
sex X D vs. S 1 -0268 .341 
sex X N vs. ¥% (D +S) 1 .0444 564 
Error (within groups) 96 .0787 


a Due to regression. 


b Due to the deviation of the N mean from the regression line. 


*p<.0l. 
** p < .005. 


From Gewirtz and Baer: Deprivation and satiation of social reinforcers as drive 


conditions. 


a one-tail t test. That mean score (.22) is 
found to be reliably greater than zero at 
p < .0005. A similar test indicates that the 
Satiation condition of this study did not 
reduce the reinforcing effectiveness of ap- 
proval to a zero level; the mean reinforcer 
effectiveness score following Satiation 
(.13) was reliably greater than zero at 
p < .01. Hence, it may be concluded that 
approval was effective as a reinforcer un- 
der all conditions, and that satiation was 
not complete but only relative. 


SPONTANEOUS SOCIAL INITIATIONS 


An examination of Ss’ spontaneous ver- 
bal initiations to E during only the four- 
minute baseline period of the game can 
reinforce the conclusions drawn from the 
reinforcer effectiveness score (which re- 
flects only the susceptibility of Ss to ap- 


proval as a reinforcer). These initiations 
could be expected to represent behaviors 
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FIG. 2. A pictorial representation of the 
means for the three levels of the experi- 
mental variable (34 Ss per condition). 
From Gewirtz and Baer: Deprivation and 
satiation of social reinforcers as drive con- 
ditions. 


DEPRIVATION AND SATIATION OF SOCIAL REINFORCERS AS DRIVE CONDITIONS 5¢ 


by S for a variety of social reinforcers 
from E and, hence, might be sensitive as 
well to the treatments. It should be noted 
that E did not dispense approval during 
the baseline period, but merely looked on 
as S put marbles into the toy. (Because 
the Satiation treatment consisted of a pe- 
riod of intensive social contact between E 
and S, which could encourage S to con- 
tinue to make social initiations during the 
game, only a comparison of the verbal 
social response scores between the Depri- 
vation and Nondeprivation groups would 
be meaningful.) 

The total frequency of verbal initiation 
scores was classified in a 2 x 2 factorial 
(Deprivation vs. Nondeprivation and 
Boys vs. Girls) and subjected to an analysis 
of variance. The mean number of verbal 
responses (Comments, Questions, and 
Attention-seeking) after Deprivation 
(4.4) was found to be reliably greater 
than that after Nondeprivation (2.3) at 
p< .05 (F = 3.70, 1 and 64 df, one-tail 
test). At the same time, the Treatment 
x Sex interaction effect was not reliable, 
indicating that the two treatments did not 
affect the sexes differentially. 

The scale scores represent what appears 
to be the intensity of social contact, or the 
degree to which certain social reinforcers 
apart from approval (e.g., attention) are 
sought from the adult, and could take any 
one of the four values from zero to three. 
They were classified in a fourfold table, 
with low scores of zero and one taken to 
represent less intense social contact, and 
high scores of two and three taken to rep- 
resent more intense social contact. It was 
found that 20 out of the 34 Ss exhibited 
high scale scores after Deprivation, while 
only 12 of the 34 Ss exhibited such high 
scale scores after Nondeprivation, indicat- 
ing at p< .05 (chi square corrected for 
discontinuity = 2.89, 1 df, one-tail test) 


that a greater proportion of Ss exhibited 
more intense social contact scores after 
Deprivation than after Nondeprivation. 

Hence, the two relatively independent 
indices derived from the three categories 
of spontaneous verbal initiations to E 
both reinforce the conclusions derived 
from the measure of the reinforcing effec- 
tiveness of E’s approval. 


DISCUSSION 


In the earlier study cited (as in this 
study), the experimental operation of 
brief social isolation of the child was 
equated to a condition of deprivation® of 
all social reinforcers (including approval). 
Hence, it became important to demon- 
strate that this condition increases the 
incidence of behaviors for approval rela- 
tive to an empirically defined level of sati- 
ation for that reinforcer. The results sug- 
gest that this has been accomplished. And 
since under the Nondeprivation condition 
Ss had just come from class, with no fur- 
ther experimental treatment, it seemed 
reasonable that it would represent some 
point intermediate between the other con- 
ditions. The rank-order of the mean rein- 
forcer effectiveness scores for these three 
conditions followed this logic precisely 
and was uncomplicated by an interaction 
involving sex of Ss. Hence, the results 
replicate the finding of the earlier study 
concerning the greater effectiveness of ap- 
proval after Deprivation, relative to Non- 
deprivation. While the mean difference 
between reinforcer effectiveness scores for 
Deprivation and Nondeprivation for the 
Ss in this © idy (ranging in age from 6-6 
to 9-0) ap ars to be of the same order 


6 An analysis of some possible Depriva- 
tion condition artifacts is made in (6). 
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as that for the Ss in the earlier study (who 
ranged in age from 3-10 to 5-3), the ab- 
solute level of the means appears to be 
higher. 

The two indices drawn from the three 
spontaneous verbal social initiation cate- 
gories reinforced the conclusions based on 
the index of the reinforcing effectiveness 
of E’s approval for the Deprivation and 
Nondeprivation conditions (where a dif- 
ference test was meaningful), It seems 
likely then, if the game-set were dispensed 
with and the natural or spontaneous so- 
cial initiations to E were employed as the 
sole dependent variable, that similar con- 
clusions would be drawn from the results. 
However, if the present establishing oper- 
ation for satiation were to be employed in 
such a study, it would still be almost im- 
possible to separate the social effects of 
satiation from the artifactual effects of Ss’ 
greater familiarity with E. 

The essence of the parallel between our 
use of the term drive for social reinforcers 
and the traditional use of the term for the 
deprivation of food and water reinforcers, 
as in hunger and thirst, lies in the defini- 
tion of a drive as the functionai relation 
between deprivation for a reinforcer and 
responding for that reinforcer, In that 
special sense, then, it would appear that 
there exist for children social drives that 
respond to social reinforcer deprivation 
similarly as do many primary appetitive 
drives. Yet it should not be supposed that 
the results of this study validate decisively 
the conclusion that a social reinforcer fol- 
lows a deprivation-satiation logic. The re- 
sponsiveness of a reinforcer to relative 
values of both deprivation a d satiation 
represents only one requirement under 
this logic. Social reinforcers may be sup- 
plied and deprived in a variety of ways, 
and it is important to discover their re- 
sponsiveness to many of these ways. It 


would be especially important, for ex- 
ample, to implement the deprivation of a 
single social reinforcer, rather than of all 
social reinforcers. Further, it is essential 
to have some assurance that the social re- 
inforcers are more or less homogeneous in 
this regard, for verbal approval may not be 
representative of the reinforcers control- 
ling the purely social initiations made by 
children to adults. Replications of these 
effects with other social reinforcers (e.g. 
attention) would strengthen the conclu- 
sions, as would parametric studies of the 
deprivation-satiation dimension. Another 
assumption is that approval had acquired 
reinforcing value for children through a 
history of conditioning. A stronger case 
would result if approval were demon- 
strated to be a more effective reinforcer 
than, say, a comparable nonsocial noise 
produced by a machine; or if that noise 
were shown to be less affected than ap- 
proval by deprivation-satiation conditions 
like those employed here. Even so, the 
earlier finding (6) that isolation enhanced 
the reinforcing power of adult approval 
for Ss as a positive function of the degree 
to which they sought adult approval in 
other settings would indicate against both 
these possibilities. And the difference in 
spontaneous social initiations following 
Deprivation and Nondeprivation supports 
the more general conclusions drawn here; 
those behaviors were very likely employed 
for social reinforcers other than approval. 

While the results of this study can 
stand in their own right, several additional 
experimental conditions could help eluci- 
date the processes at issue. Thus, it would 
be useful to separate the effects of some 
of the three components of the satiation 
condition employed, namely, (a) E’s 
physical presence, (b) the social inter- 
action between E and S, and (c) the ap- 
proval reinforcers dispensed by E to S. To 
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do this, it would be necessary to employ 
such conditions as, for example, one in 
which E sits with S for 20 minutes but 
says nothing, or one in which approval is 
dispensed without E, possibly out of “thin 
air.” While some such conditions might 
be difficult to implement, the attempt to 
establish conditions like these would be 
worth while in the context of this experi- 
ment. Even so, the results of an experi- 
ment (3) on related behavior (for atten- 
tion) suggest that a condition in which E 
sits near § but interacts minimally with 
him (only upon request) functions more 
as a condition of social deprivation than 
as one of satiation (7). 

Apart from these considerations, the 
standard primary-conditioned reinforcer 
issue in the study of animal drives cannot 
be involved as such in this case. We have 
assumed that some sort of conditioned 
reinforcer is at issue, but haven’t separated 
out conclusively the effects of the several 
stimulus components of that conditioned 
reinforcer. At the very worst, then, it isn’t 
clear that the social reinforcer dispensed 
is independent of E. We have already 
noted the possibility that noise, rather 
than social noise, might constitute the 
reinforcing stimulus. Apart from this, 
however, it does not seem significant to 
consider social reinforcers as separate from 
the person dispensing them: they are emi- 
nently social noises in our logic; and their 
social character refers not only to their 
presumed history but also to the method 
of their delivery. 


Additional considerations 


In the earlier study, two Es were em- 
ployed to dispense the social reinforcer, 
one male and one female. An interaction 
effect was found which indicated, among 
other things, that the increase in the 


effectiveness of approval as a reinforcer, 
brought on by Deprivation relative to 
Nondeprivation, was greatest for boys 
with the female E. This change was not 
reliable for the other three Sex of S x Sex 
of E groups. In this experiment, in which 
both boys and girls were tested by a 
female E, no Treatment x Sex interaction 
was found (although the Satiation mean 
of girls may not have differed from zero). 
Hence, to that extent, the previous results 
are not replicated, but the conclusions 
can be drawn more generally. (This find- 
ing could be referred to the postulate that 
Ss of this study are “latent” [in the Freud- 
ian sense], while those in the earlier study 
were “Oedipal.” However, there exist 
other possibilities, including slight 
changes in method, to explain the dis- 
cordant results of the two studies on this 
issue.) 

Only one reinforcer-dispensing E was 
employed, and she was not unaware of 
the expected direction of the results. Her 
behavior was scored by objective and 
easily discriminated criteria and judged 
satisfactory. Still, there remains some 
reason for caution; for the findings of this 
experiment cannot be conclusive until 
they are widely replicated with similar 
and improved procedures. Nevertheless, 
the reliability of the results is supported 
by the difference between the Deprivation 
and Nondeprivation groups on the spon- 
taneous social initiations made to E before 
she began to dispense the reinforcer: 
there, where it was even less likely that E 
could influence the outcome, the finding 
paralleled precisely that derived from the 
reinforcer effectiveness index. 


SUMMARY 


On the assumption that approval is 
representative of the reinforcers control- 
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ling the purely social initiations of chil- 
dren to adults, the verbal approval of a 
female E was made contingent upon one 
response in a two-response game for 102 
first- and second-grade children (Ss) of a 
university laboratory school. The change 
in relative response frequency from a 
baseline level following introduction of 
the reinforcer indicated the degree to 
which approval was reinforcing for an S. 

Before playing the game, Ss were sub- 
jected to one of three experimental con- 
ditions: 34 Ss were subjected to a 20- 
minute period of isolation (conceived to 
be social Deprivation); 34 Ss played the 
game immediately upon coming from 
class (conceived to be an intermediate 
condition between deprivation and satia- 
tion, and called Nondeprivation); and 34 
Ss devoted 20 minutes to drawing and 
cutting out designs, while E maintained 
a stream of friendly conversation with 
each of them and approved and admired 
their art efforts and statements in an ap- 
propriate fashion (conceived to be Satia- 
tion for approval and social contact). 
There were 17 boys and 17 girls in each 
experimental group. 

Employing two independent tests (one 
on the order of the means, the other on 
the regression of the means on the treat- 
ment dimension), it was found that the 
rank-order hypothesis advanced was re- 
liably supported (at p < .03 and p < .005 
respectively). The reinforcing effective- 
ness of approval was relatively greatest 
after Deprivation, intermediate after Non- 
deprivation, and least after Satiation. Ap- 
proval functioned as a reinforcer after all 
conditions, even  Satiation (p < 01). 
Boys and girls were affected similarly on 
this measure by the experimental condi- 
tions. 

The spontaneous social initiations made 


by Ss to E, before she had begun to dis- 
pense approval in the game, supported the 
results based on the index of the effective- 
ness of approval as a reinforcer, F ollowing 
the Deprivation condition, there resulted 
a greater mean frequency of social initia- 
tions (p < .05), and a larger proportion 
of Ss exhibiting apparently intense social 
interaction (p < .05), than there did fol- 
lowing the Nondeprivation condition, 
(The nature of the establishing operation 
for the Satiation condition precluded a 
meaningful comparison of the other con- 
ditions with it on these social behaviors.) 

Thus, a reinforcer appearing to be typi- 
cal of those involved in children’s social 
drives appears responsive to deprivation 
and satiation operations of a similar order 
as those controlling the effectiveness of 
reinforcers of a number of the primary 
appetitive drives, 
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chapter I II 


Verbal Behavior 


Ir HAS BEEN STATED many times that above everything else it is language 
behavior which most distinguishes man from lower animals. Furthermore, 
language appears to be fundamental to most other behaviors of man in 
which we are interested. The greatest achievements as well as common- 
place adjustments, intellectual as well as social-emotional behaviors, and 
scientific as well as artistic activities depend upon language. Moreover, 
the acquisition of new skills, intellectual and motor, depends heavily upon 
language. And few social interactions occur that do not depend upon or 
involve language. ‘Thus, we must be interested in both the manner in 
which language is acquired as a learned behavior repertoire as well as in 
how that repertoire functions in the individual’s adjustment and further 
learning. In recent years there has been a sharp acceleration in experi- 
mental and theoretical activity concerning the learning of language and also 
the function of language. The present chapter, the following one, and later 
articles will deal with language as it is important to such human activities 
as communication, thinking and reasoning, purposive planning, attitude 
development and change, motivation, social interaction, and mathematics 
learning. 

The present section is concerned with the way in which some of the 
principles of operant conditioning have been extended to the consideration 
of verbal behavior. This field of study originally received its greatest impetus 
from B. F. Skinner in his book Verbal Behavior (1957). Prior to the ac- 
cumulation of experimental evidence based upon a strict operant condition- 
ing methodology, Skinner outlined a number of forms of language behavior 
which are apparently acquired according to reinforcement principles. Some 
of the outcomes of that analysis are presented herein. 

The article analyzing a comparison in the development in speech and 


64 


VERBAL BEHAVIOR 65 


reading is presented first because it summarizes some of the relevant operant 
conditioning principles and indicates how they may be involved in the 
acquisition of certain important aspects of language. Although the article is 
concerned especially with reading, it presents a general analysis which is a 
foundation for subsequent studies in other sections as well as the present 
one. A more detailed analysis of reading acquisition which follows from this 
article will be presented later in this section. 

Following Skinner’s analysis of verbal behavior in terms of operant con- 
ditioning principles, a number of experimental studies were conducted in 
which the single principle of reinforcement was extended to this realm of 
behavior. This was done by applying some reinforcing stimulus contingent 
upon a class of verbal behaviors. The frequency of occurrence of members 
of the class of verbal responses was tabulated in these studies to see if the 
expected strengthening effect of reinforcement took place. In general the 
effect has been observed—when members of a class of word responses are 
reinforced, the members of the class are emitted in greater frequency. Al- 
though this type of result requires a more detailed analysis (which will be 
given in the next chapter), the studies do indicate that response contingent 
reinforcement can shape verbal behavior. The next two studies, in addition 
to the specific contributions they make, also show clearly the effect of 
reinforcement upon verbal behavior. 

In the next study by Rheingold, Gewirtz, and Ross, the fact that rein- 
forcement principles begin to effect verbal behavior at even very early ages 
is shown. Vocal responses in three-month-old infants are strengthening 
through response contingent social reinforcement. This study appears to 
have many implications. First, by its success, it suggests that experimental 
methods may be devised for research on this central type of behavior even 
when the behavior is still very primitive. In addition, the study has implica- 
tions for practical considerations and suggests further study. That is, if 
reinforcement in a short experimental procedure can shape the infant’s 
language development, might not a systematic study of various aspects tell 
us a good deal about maximal conditions for producing good language 
development. The last article in this chapter will deal with these implica- 
tions in greater detail. 

The article by Salzinger, Salzinger, Portnoy, Eckman, Bacon, Deutsch, 
and Zubin gives additional support to the suggestion that reinforcement 
variables continue to shape verbal behavior in children. Continuous speech 
in 6-7-year-old children was increased through reinforcement. Reinforce- 
ment schedules were also found to effect resistance to extinction of the 
conditioned rate of speech. 

In addition, to providing the theoretical analysis which gave impetus to 
the experimental study of language in terms of operant conditioning prin- 
ciples and methods, B. F. Skinner and his associates have also extended a 
similar analysis to some of the problems of education. Much educational 
training involves the development of verbal repertoires of behavior which 
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are under appropriate stimulus control, according to this view. As a conse- 
quence, the reasoning might go, an analysis of the behavior involved in 
terms of its units, could lead to a better method of shaping the final 
repertoire. In addition, some of the technology which has been developed 
to achieve experimental control in the laboratory may be adapted to edu- 
cational procedures so that the presentation of the stimulus materials could 
be maximal in effect and not subject to uncontrolled vagaries. Furthermore, 
immediately presented, response-contingent reinforcement should help 
solve the problems involved in maintaining “studying behavior.” The next 
two articles deal with the extensions of reinforcement principles and meth- 
ods, especially those involved in the analysis of verbal behavior, to some 
applications to educational problems. 

The first article by Holland is presented to show the relationship of the 
programed instruction movement to laboratory established principles and 
methods, and to summarize some of the concepts of programed instruction, 
Next, Gilbert, in this excerpt from a longer article, discusses first some basic 
behavioral principles, reinforcement and response chaining. Then he ap- 
plies these concepts to the analysis of the act of long division and to a 
method for programing this type of learning, Gilbert’s article also has 
general significance in showing the importance of the “theoretical” analysis 
of a task in behavioral terms prior to commencing research or programing— 
a point which is made explicit later. 

Applications of programed instruction techniques have now been applied 
to a wide number of different subject matters. However, the movement 
should not be seen only as a specific technology of programing various 
academic subject matters. The most general implication of the movement 
is that experimental methods and learning principles are applicable to the 
study of various problems of human behavior—not just to circumscribed 
problems of traditional classroom education. The next article indicates 
some of the possibilities for extensions beyond the original definition of 
the field of programed instruction. 

This article summarizes a long-term research project which attempts 
an analysis of the original acquisition of reading, following the approach 
laid down in the first article in this chapter. In addition, an outline is given 
of a general strategy for the further extension of learning principles and 
methods to the study of various complex human behaviors. This strategy 
and the problems discussed are relevant also to the final chapter of this 
book which is concerned with the treatment of problems of behavior. It 
is suggested here that the empirical principles of behavior have been vali- 
dated within the context of complex human behavior and the treatment 
of behavior problems. However, the task of completing experimental and 
theoretical analyses of complex human behavior problems in learning 
terms as well as the task of developing (learning) programs for the treat- 
ment of these problems lies largely ahead. 
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A Comparison of the Development of Speech and 
Reading Behavior with Implications for Research * * 


Arthur W. Staats and 
Carolyn K. Staats 


Recent experimental and theoretical 
work in experimental psychology provides 
a framework for understanding some of 
the special problems which exist in the 
development of language. The purpose of 
the present paper is to extend a number 
of the established behavioral principles to 
the area of language development and to 
emphasize some of the special problems 
involved in the acquisition of reading 
skills. 

The principles to be developed are 
those of operant conditioning or operant 
learning and the primary sources are Kel- 
ler and Schoenfeld (7) and Skinner (12). 
In this respect, the present approach is 
like that of Gewirtz (3), who discussed 
emotional dependence in this JOUR- 
NAL. The language activities of children 
are considered herein to be behaviors 


* From A, W. Staats and C. K. Staats, A 
comparison of the development of speech 
and reading behavior with implications for 
research, Child Developm., 33, 831-846 
(1962). Reprinted by permission of the 
authors and The Society for Research in 
Child Development, Inc. 


which are subject to these principles of 
acquisition. A full presentation of lan- 
guage development must include the 
principles of classical conditioning and 
the interaction of classical and operant 
principles in the development of word 
meaning (13, 14, 15, 17). However, these 
principles will not be dealt with at this 
time. 

Specifically, this paper will describe the 
principles by which speech responses in 
general, and speech responses to particu- 
lar aspects of environmental stimuli, are 
developed into precise language behav- 
iors. It will be pointed out that in certain 
respects the teaching of verbal responses 
to visually presented verbal stimuli (read- 
ing) deviates from the acquisition of 
speech in ways which make the acquisi- 
tion of reading much more difficult. Con- 
sideration of the principles involved and 
the differences in the two types of learn- 
ing should yield a better understanding of 
the problems involved in learning to read 
and thus suggest productive lines of re- 
search, 


1The analysis was made by the first 
author in a longer version as the basic 
rationale for a research project on reading, 
and prepared for journal publication with 
the help of the second author, The project 
was sponsored by the Office of Education, 
Cooperative Research Branch, under Con- 
tract No. 1048 and by the Office of Naval 
Research under Contract Nonr-2794(02). 
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Principles 
Operant LEARNING 


A simple and very general law of be- 
havior is that a response followed by 
certain “consequences,” which in every- 
day life are called rewards, will in the 
future occur more frequently. That is, the 
response will be strengthened. The objec- 
tive term for such a consequence is posi- 
tive reinforcer or reinforcing stimulus. On 
the other hand, a response whose “conse- 
quence” is the removal of an aversive state 
of affairs is also strengthened. A stimulus 
whose removal has this effect is called a 
negative reinforcer. Stimuli whose re- 
moval is reinforcing are called “unpleas- 
ant” or “punishing” in everyday life. 


REINFORCING STIMULI 


Reinforcing stimuli may differ for dif- 
ferent species and for different individuals 
within a species. Some stimuli have this 
reinforcing effect soon after birth without 
any evidence of training being required. 
To a baby deprived of milk, milk as a 
stimulus object will strengthen any oper- 
ant behavior it follows. Food, water, 
warmth, and other such stimuli are un- 
learned, or primary positive reinforcers. 
Conversely, since the removal of wet and 
chaffing diapers will strengthen the re- 
sponse of crying, this event constitutes a 
primary negative reinforcer, 

There are many other stimuli which 
originally are not reinforcing, ie., are 
neutral with respect to their effect upon 
the strength of behavior, but which be- 
come “secondary” reinforcers by being 
present when a reinforcing stimulus oc- 
curs. A neutral stimulus paired with the 
presentation of a positive reinforcer will 
become a positive reinforcer itself; a 


neutral stimulus paired with the presenta- 
tion of a negative reinforcer will become 
a negative reinforcer. 

In addition, responses may themselves 
become secondary reinforcers, This can 
occur because every response of an organ- 
ism produces stimuli which, if frequently 
associated with reinforcement, may be- 
come reinforcing stimuli themselves. 


Time AND SCHEDULING 
oF REINFORCEMENT 


Although detail is not possible here, 
some additional principles should be 
stressed. First, the time intervening be- 
tween the response and the reinforcer is 
very important. The shorter the interval, 
the more the response is strengthened for 
future occasions. If the interval is too 
long, learning does not occur. Secondly, 
the schedule of presenting reinforcement 
is also crucial. For example, after a re- 
sponse has been reinforced many times, 
it is possible to maintain the response at 
some strength by reinforcing it only a 
portion of the times it is emitted. The 
ratio of nonreinforcement to reinforce- 
ment trials may be slowly increased until 
the response is maintained in strength by 
very infrequent reinforcement. 


SUCCESSIVE APPROXIMATION 


Many responses occur so infrequently 
that it would be highly impractical to 
wait for their occurrence so that they 
could be reinforced. However, operant 
learning can take place in a gradual man- 
ner. A response which ordinarily would 
not occur in finished form can be 
“shaped” by first rewarding gross ap- 
proximations to the final response and 
then gradually reinforcing only the better 
approximations to the desired response. 
This type of shaping is possible because 
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a particular response is actually a member 
of a class of similar responses. Each re- 
sponse has many variations and involves, 
prior to refined operant training, other 
closely related responses. Thus, reinfore- 
ing a response actually strengthens a class 
of responses which will include variants 
which are closer approximations to the 
final response desired. When the more 
desirable variants are selectively rein- 
forced, a new class of responses will be 
strengthened which will include new 
variants even closer to the desired re- 
sponse, and these may then be reinforced. 
The process of differentiating out the de- 
sired variants in each class in a series of 
steps is called successive approximation. 


CHAINING 


Every response produces characteristic 
stimuli, thus responses themselves may 
become “joined” into chains or series of 
responses through conditioning. One re- 
sponse, through the stimuli it produces, 
will come to control the next response, 
and so on. This is the principle of chain- 
ing. Most sequences of skilled movements 
are of this type, as are chains of associated 
word responses in adult language. 


EXTINCTION 


Another important principle is that of 
extinction. A response which has been 
strengthened by reinforcement will 
weaken if it is no longer followed by rein- 
forcement. Thus, to weaken a response to 
its prereinforcement strength, reinforce- 
ment should be withheld whenever that 
response occurs. 


DISCRIMINATION AND GENERALIZATION 


For human adjustment it is important, 
not only that a response be made, but 


also that it be made in the appropriate 
circumstances or stimulus situation. The 
principle of stimulus discrimination de- 
scribes how a stimulus comes to control 
a particular response. When a response is 
reinforced in the presence of a certain 
stimulus and is not reinforced in the 
absence of the stimulus, that response will 
come to occur only in the presence of the 
stimulus. When the stimulus occurs the 
response occurs; when the stimulus is 
withdrawn the response does not occur, 
or does so only infrequently. 

In addition, when a particular stimulus 
has come to control a response, similar 
stimuli will, to the extent of their simi- 
larity, also control this same response. 
This is called the principle of stimulus 
generalization. 


Extension of These Principles 
to Certain Aspects of Language Behavior 


While these principles in their simple 
form will not account for all of language 
behavior, some significant applications of 
the principles may be made within the 
scope of this paper. The discussion will 
deal first with certain aspects of the de- 
velopment of the child’s early language 
behavior and then with some of the spe- 
cial problems in the acquisition of reading 
behavior. 


SPEECH LEARNING 


During the first month of life, for the 
most part, a baby’s vocal sounds do not 
resemble speech. Vocalizations involve 
crying, a few squeaks, clucks, and so on. 
During the first several months, however, 
the infant produces varied sounds which 
have duplicates in human speech. 

The extent to which the first behavioral 
development of this kind as due to matu- 
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rational factors versus the effects of rein- 
forcement history need not concern us 
here. It is important to note, however, 
that a study by Rheingold, Gewirtz, and 
Ross (11) has shown that this type of 
behavior can be operantly conditioned 
even at an early age, under the action of 
an adult’s social response as the reinforcer. 
In this very simply conducted study 12 
3-month-old infants were used as subjects. 
First, a preconditioning baseline tabula- 
tion was made for each infant. During this 
period the experimenter was in view of 
the infant, but maintained an expression- 
less face. During the conditioning phase 
the experimenter reinforced each vocal 
response by smiling, clucking, and lightly 
squeezing the infant’s abdomen. In the 
third phase of the study, extinction, the 
experimenter again did not reinforce the 
speech responses. The authors found (a) 
that the mean vocalizing rate was higher 
during conditioning than during baseline 
or extinction and (b) the mean rate was 
higher during the second than during the 
first conditioning day. The importance of 
these results can be seen more clearly when 
it is realized that this primitive speech 
behavior is the basic class of behaviors 
from which more and more precise speech 
responses may be differentiated. 


Sources OF REINFORCEMENT 


Before discussing further the develop- 
ment of speech, the types of reinforcers 
which are effective in shaping early vocal 
behavior should be noted. One type of 
reinforcement is that which is delivered 
by the parents at the time of the response. 
This could involve primary reinforcers 
such as food, relief from pain, etc., or, as 
in the Rheingold, Gewirtz, and Ross 
study, secondary reinforcers such as the 


smiles of the parents and the sounds they 
make, 

Another important source of reinforce- 
ment involved in the child’s language de- 
velopment consists of the sounds which 
the child himself produces. Mowrer (9) 
and Miller and Dollard (8) have de- 
scribed the manner in which the sounds 
the child produces become secondary re- 
inforcers and shape early language devel- 
opment. 


Since the mother talks to the child while 
administering primary rewards such as food, 
the sound of the human voice should acquire 
secondary reward value. Because the child’s 
voice produces sounds similar to that of his 
mother’s, some of this acquired reward value 
generalizes to it. . . . From this hypothesis 
it may be deduced that children talked to 
while being fed and otherwise cared for 
should exhibit more iterative and imitative 
babbling than children not talked to while 
being rewarded (8, p. 277). 


In the terms developed in the present 
discussion, the sounds of the mother’s 
voice become secondary positive rein- 
forcers because these sound stimuli have 
been paired with other positive reinforcers. 
On this basis it would be expected that 
a response on the part of the child which 
produced a sound that was in some way 
similar to sounds produced by the parents 
would be strengthened and would occur 
more frequently. 


FURTHER DEVELOPMENTS 
IN EARLY SPEECH 


On the basis of recordings made of a 
child’s vocalizations during the first year 
of life, Osgood has concluded that infants 
make “all the speech sounds that the 
human vocal system can produce, includ- 
ing French vowels and trills, German 
umlaut and guttural sounds, and many 
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that are only describable in phonetic 
symbols. This is in flat contradiction to 
the notion that the infant gradually ‘be- 
comes capable’ of making various sounds” 
(10, p. 684). Evidently the structures and 
muscular flexibility are present by which 
the infant can produce many different 
sounds—many more than he will eventu- 
ally make habitually. 

Although the infant may initially make 
all types of speech sounds, in time the 
frequency of making certain sounds under- 
goes a change. Thus, a child’s vocal be- 
havior becomes increasingly more like that 
of the vocal behavior of the adults in the 
child’s environment (5, 6). This progres- 
sion would be expected on the basis of 
certain sounds of the parents becoming 
positive conditioned reinforcers. As an ex- 
ample, the language environment of a 
child raised in an English-speaking home 
would consist of syllable sounds like ba, 
ma, da, kee, lo, foo, etc. Since these 
sounds occur frequently in the speech of 
the parents, and in the presence of posi- 
tive reinforcers given by the parents, 
they become positive reinforcers. Vocal 
responses by the child which produced 
similar sounds would thus be immediately 
reinforced and the responses would in- 
crease in frequency. Responses which pro- 
duced sounds which were not reinforcing 
in this way would extinguish, or not in- 
crease in strength. 

On the basis of this principle, and after 
a series of such differentiations from the 
infant’s extended class of speech response, 
the child’s speech repertoire includes re- 
sponses more and more like the syllables 
which occur in the adult speech of his 
language community. This type of verbal 
behavior is often called babbling. Many of 
the sounds now produced by the vocal re- 
sponses will approximate word and phrase 
responses emitted by the parents. It is 


interesting to note, as would be expected 
on the basis of this analysis, that deaf chil- 
dren do not progress into the babbling 
stage of vocal development in the same 
manner as children with normal hearing. 
Since the deaf child is not sensitive to the 
speech sounds, they cannot become sec- 
ondary reinforcers and strengthen his own 
vocal responses. 

From the babbling stage to the devel- 
opment of the first few speech responses 
which are appropriately emitted involves 
continued differentiation of the class of 
babbling responses. However, when the 
child finally utters its first clearly recog- 
nizable words in the proximity of the par- 
ents, there is customarily immediate and 
strong reinforcement, and the child’s 
verbal response class enters a new phase 
of more rapid shaping. At this point the 
parents’ direct and immediate reinforce- 
ment of speech responses probably as- 
sumes an important role in the shaping of 
the child’s speech, although the self-rein- 
forcement provided by saying words like 
those of the parents will continue to be 
effective. The parents now become more 
sensitive to the speech responses of the 
child and reinforce even close approxima- 
tions to English words. Speech responses 
like “wahwah” may be reinforced with a 
drink of water, and “da” may be rein- 
forced by the presentation of the child's 
toy dog. In this manner a rudimentary 
repertoire of speech responses is further 
differentiated out of the large class of 
vocal responses which the child formerly 
made. 


CONTINUED SHAPING OF SPEECH 
‘THROUGH SUCCESSIVE APPROXIMATION 


However, “wahwah, wahda, wuhda, 
wata, watah,” and so on, are not examples 
of the precise speech sound of “water” 
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which is made in the English speech com- 
munity. Further successive approximation 
from several sources of reinforcement acts 
to shape gradually the speech responses of 
the child to more and more precise dupli- 
cates of adult speech. 

There are several sources of this differ- 
ential reinforcement. First, adults or other 
children less familiar than the parents with 
the child’s speech may not respond at all 
to the child’s grosser verbal responses, 
thus reinforcing only the better pronun- 
ciations. In this way, the better responses 
of the child will be subjected to greater 
reinforcement and the poorer ones extin- 
guished. Or better responses may be more 
quickly reinforced. For example, when the 
child emits a verbal response and is asked, 
“What did you say?” reinforcement is 
postponed, a further response is required, 
and this verbal response receives less 
strengthening than one to which the lis- 
tener immediately makes an appropriate 
response. Thus, the differential reinforce- 
ment of better speech responses by par- 
ents and by others, especially in terms of 
the time of reinforcement, is responsible 
for the gradual shaping of better speech 
behaviors in the child. 


FORMULATION OF VERBAL 
DISCRIMINATIONS 


Progress in speech development also in- 
volves discrimination training which re- 
sults in a type of speech behavior that 
Skinner calls echoic behavior. What is 
meant by this term is that the child learns 
to echo, or repeat, what the parent says, 
upon request to do so. 


An echoic repertoire is established in the 
child through “educational” reinforcement 
because it is useful to parents, teachers, and 
others. It makes possible short-circuiting of 
the process of progressive approximation, 


since it can be used to evoke new units of re- 
sponse upon which other types of reinforce- 
ment may then be made contingent. The 
educational reinforcement is usually sup- 
plied with the aid of . . . Say ‘X, where 
the listener, becoming a speaker, is rein- 
forced if his response yields the sound pat- 
tern ‘X’ (12, p. 56). 


It is important to point out that syllabic 
units come under “echoic” control so that 
entirely new words may be quickly pro- 
duced by the child when he “echoes” the 
syllables pronounced by the adult training 
him. The learning task which remains in 
this case only involves establishing a chain 
between the syllable responses the child 
already has in his repertoire. 


SPEECH DISCRIMINATION 
TO ENVIRONMENTAL STIMULI 


In order to present clearly the different 
principles involved, the process of shaping 
correct speech was separated from the 
processes involved in the emission of the 
speech at the proper time and place; that 
is, the process whereby speech comes un- 
der the control of the appropriate environ- 
mental stimuli. In actuality, the child is 
involved in both types of learning simul- 
taneously. He is trained to make “good” 
speech responses at the same time he is 
trained to make them only in certain 
circumstances. The principle involved is 
the discrimination of a speech response 
(12). 

When the child first says “daddy” or an 
approximation, the child’s parents usually 
reinforce this response, whether or not the 
father is present, and whether or not the 
child is looking at the father. This experi- 
ence strengthens the response, but in the 
presence of many different stimuli. Thus, 
the response does not occur in any specific 
situation. Once this speech response has 
been strengthened to the point where it 
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occurs frequently, however, even to inap- 
propriate stimuli, the discrimination train- 
ing customarily starts. Only when the 
child says “daddy” in the presence of the 
father does reinforcement occur. The re- 
sponse is consequently extinguished in the 
presence of other adults and children. 

At this point the response might not be 
precisely under the control of the ap- 
propriate stimulus. Although the child no 
longer says “daddy” in the presence of 
mother and does in the presence of the 
father, it might be found that he also says 
“daddy” in the presence of stimulus ob- 
jects similar to father, for example, other 
males. A salesman calling in the after- 
noon, when father usually comes home, 
may be greeted by the child’s response, 
“daddy.” This is of course an illustration 
of the simple principle of stimulus gen- 
eralization. However, since the child will 
not be reinforced for this generalized re- 
sponse, in due time his speech response 
will come under the precise control of the 
stimulus object, father. Skinner calls such 
a discriminated speech response a tact. 


A tact may be defined as a verbal operant 
in which a response of given form is evoked 
(or at least strengthened) by a particular 
object or event or property of an object or 
event. We account for the strength by show- 
ing that in the presence of the object or 
event a response of that form is character- 
istically reinforced in a given verbal com- 
munity (12, pp. 81-82). 


After the child has acquired the basic 
sounds involved in English speech and is 
able, within limits, to produce sounds 
which match (i.e., echo) those produced 
by someone else, rapid speech vocabulary 
growth is possible. The mother can then 
simply present a new object and say its 
name, e.g., hold up a ball and say “ball.” 
Reinforcement of the child’s matching re- 


sponse while looking at the ball will estab- 
lish the tact. 

Numerous experiences of this type oc- 
cur. When the child goes for an automo- 
bile ride with his parents, for a walk to the 
store, and so on, there are occasions when 
the child looks at an object or event at 
the same time as the appropriate word is 
presented. The child is asked to repeat the 
word, and the response is then reinforced. 
The child learns in this manner to tact 
environmental events as well as objects. 
For example, in the presence of a moving 
automobile the child is told that it is mov- 
ing. When the child says “moving” in the 
presence of something moving, he is rein- 
forced. A moving object will thus become 
the discriminative stimulus for that speech 
response. If an automobile is also a dis- 
criminative stimulus for the response 
“automobile,” then in the presence of a 
moving automobile the child will tend to 
emit the response, “automobile moving,” 
or some such statement. The child will 
thus learn simple and complex speech re- 
sponses to environmental events, both 
simple and complicated. 

The learning of tacts is also carried on 
in great detail in ordinary language train- 
ing. Although the child may first be rein- 
forced for saying “automobile” in the 
presence of the total stimulus object, he 
will eventually be reinforced for emitting 
the appropriate speech responses to various 
parts of the object. Thus, detailed discrimi- 
nation training involving particular aspects 
of the total stimulus situation is ordinarily 
conducted as is shown in the number of 
environmental events which control par- 
ticular speech behaviors. 

In addition to this type of discrimi- 
nated verbal behavior, a child will ordi- 
narily receive training in responding to 
internal stimuli such as aches and pains, 
to stimuli produced by his own behavior, 
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and to other types of stimuli. Thus, many 
complex, detailed, and subtle stimulus 
events eventually come to control the ap- 
propriate complex speech responses. 


The Acquisition of Reading Behavior 
TEXTING 


It is important that speech responses be 
brought under the control of appropriate 
external and internal stimuli. In addition, 
it is equally important that speech re- 
sponses come under the control of ap- 
propriate visually presented verbal stimuli. 
In Skinner’s terminology (12) this is 
called texting. A textual response is a 
speech response that is under the control 
of the appropriate visually presented ver- 
bal stimulus. In everyday terms this is 
simply called reading. 

Textual behavior is formed in a manner 
similar to that involved in learning a rep- 
ertoire of speech responses to the other 
types of stimuli. Ordinarily, however, by 
the time training in textual behavior com- 
mences, the child has acquired the neces- 
sary speéch responses. Thus, the child is 
able to match his speech responses to 
those given by the person guiding the 
instruction. A simple model for training 
a textual response is to present the written 
verbal stimulus to the child, say the word 
aloud, and have the child make a response 
which approximates the sound. For ex- 
ample, the word dog could be presented 
to the pupil, or group of pupils, and the 
teacher says “dog.” The pupil responds 
by saying “dog” while looking at the word 
stimulus. Later, the stimulus word is again 
presented the pupil who will tend to say 
“dog” with no prompiing. When the vis- 
ually presented stimulus word will elicit 
the appropriate speech response, the child 
is said to be able to read the word. 


The verbal discriminations which must 
take place in the acquisition of reading 
are also very fine and detailed. For exam- 
ple, it will be found that a child who has 
come to respond to the stimulus the with 
the response “the” will also respond at 
first in the same manner to then, and 
perhaps to there, and so on. Since the 
stimuli are quite similar, stimulus gen- 
eralization occurs. The same is true of 
such words as pat, sat, hat, fat, and so 
forth. Thus, a great deal of training is nec- 
essary to produce the correct discrimina- 
tions. 

Textual responses may be acquired in 
finer units than whole words either 
through the repeated experiences of the 
child in reading or through formal train- 
ing. The units of which stimulus words 
are composed will come to control unitary 
speech responses of which word responses 
are composed. Accordingly, the child will 
come to emit the correct speech response 
in the presence of the syllabic units and 
single letters of which the words are com- 
posed. For example, when the stimuli p, 
s, h, and f have come to control the speech 
unit responses which produce the “p,” 
“s” “h,” and “P” sounds, respectively, 
and, if the stimulus at controls the speech 
response producing the “at” sound, then 
the discrimination between the verbal 
stimuli pat, sat, hat, and fat is complete. 

When this type of discriminative con- 
trol of textual behavior has been condi- 
tioned, the acquisition of speech responses 
under the control of novel stimulus words 
may take place. That is, the pupil be- 
comes capable of learning a new textual 
response by responding successively to the 
letters and syllables of the stimulus word. 
The syllables will be “linked” so that the 
first elicits the second, and so on, in a 
manner which had not occurred before. 
The new word response would be under 
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the control of the appropriate visual stim- 
ulus. Of course, if the word response was 
not one which the child had previously 
received training for emitting in appropri- 
ate circumstances, the simple establish- 
ment of the speech response controlled by 
a visual word stimulus would not affect its 
other language functions. The word re- 
sponse would not be under the control of 
other stimuli and would not, conse- 
quently, occur in appropriate circum- 
stances, nor would such a word be mean- 
ingful.? 


A Comparison between Speech 
Development and Reading Acquisition 


Interesting comparisons may be made 
between the learning of verbal responses 
to nonverbal stimuli and the learning of 
those same responses to visual verbal 
stimuli, that is, learning to read. It was 
said earlier that the same principles are 
involved in both types of learning. Both 
are essentially problems of establishing 
verbal responses under stimulus control. 
If that is the case, why then is reading 
behavior so much more difficult to ac- 
quire? Virtually every intact individual 
acquires adequate speech behaviors, yet 
there are many individuals who, although 
they display adequate vocal behaviors, are 
seemingly unable to learn to read, or do 
so only with great difficulty. 

It is commonly suggested that such un- 
even development is a result of some 
biological defect, such as neurological im- 
pairment. However, unless there is some 
independent observation of a defect, this 
type of conclusion may simply be ad hoc. 


2 These aspects of language learning are 
not considered herein, but have been dealt 
with in other works (13, 14, 15, 17). 


If the child is capable of acquiring differ- 
ential speech responses to the ordinary 
visual stimuli in a normal manner, then it 
should be possible for visual verbal stimuli 
also to come to control the verbal re- 
sponses. There is certainly no obvious 
difference in the stimuli themselves, since 
both are visual and both are complex. 
Ordinary language behavior requires that 
verbal responses be under the control of 
very subtle aspects of one’s stimulus en- 
vironment. The same thing is true of read- 
ing, i.e., the stimuli are no more complex. 

On the other hand, on the basis of the 
present analysis, it would seem that, ex- 
clusive of personal defect, there are some 
very real reasons why some people do not 
learn to read even though their speech 
development is otherwise normal. Actu- 
ally, for everyone, learning to read is ac- 
complished only with great difficulty in 
comparison to the acquisition of speech 
under the control of other stimuli. To 
indicate the reasons, several important 
characteristics of the acquisition of speech 
responses and the process whereby speech 
responses come under the control of exter- 
nal and internal stimuli should be empha- 
sized. 

First, as has been implicit in the previ- 
ous discussion, the process of speech 
acquisition is very gradual. Beginning with 
the strengthening of the general speech 
class in early infancy, more and more pre- 
cise speech responses are gradually shaped 
up until the exact word responses of the 
language community occur. These re- 
sponses are only gradually brought under 
the control of the appropriate stimulus 
objects in a long program of training. 
Learning sessions occur intermittently and 
are dispersed throughout the day. In addi- 
tion, new objects are introduced over a 
period of years in building up verbal dis- 
criminations. 
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Secondly, there are strong sources of re- 
inforcement involved. When the child 
first says “wahtar,” the strong reinforcer 
of a cup of water is presented. When the 
child says “baybee,” the strong reinforcer 
of a baby doll is presented. In addition, 
strong reinforcers are abundantly available 
in the attention and approval of people in 
the environment. When the child says 
“look” and another child responds by 
looking, this is a reinforcer for the verbal 
response, 

Thirdly, these strong reinforcers are in- 
dividually applied, and they are applied 
immediately following the speech behav- 
iors involved. As has been discussed, it is 
most important that the reinforcing stim- 
ulus be presented quickly after a response 
has occurred. If no reinforcer is presented, 
or if the lag is too great, the response will 
not be strengthened. 


INTENSITY OF TRAINING IN READING 


Comparing these characteristics with 
those involved in the acquisition of read- 
ing behavior, it becomes obvious that the 
learning of reading would be more diffi- 
cult for everyone. Unlike speech behavior 
itself, and speech behavior under the con- 
trol of other types of stimuli, reading is 
not gradually acquired in the preschool 
years. It is customary to introduce training 
in the acquisition of speech responses to 
visually presented verbal stimuli only 
when the child enters school. Although 
there is some attempt to make this more 
gradual through the use of nursery 
schools, kindergartens, and reading readi- 
ness programs, in comparison to the learn- 
ing of speech responses, the onset of read- 
ing training is sudden and intensive. 

This major difference between speech 
and reading learning has important conse- 
quences. For example, intensive periods 


involving the acquisition, or the perform- 
ance, of responses may be considered to 
have aversive characteristics, It has been 
shown that discriminative stimuli acquire 
aversive characteristics after an extended 
period of “working” in the presence of 
the stimuli, even when the responses in- 
volved are reinforced. That is, another 
response which will remove the discrimi- 
native stimulus will be maintained in 
some strength. Furthermore, the more in- 
tensive the “work” is (i.e., the greater the 
ratio of responses to reinforcement), the 
more aversive the discriminative stimulus 
becomes (1). 

Naturalistic observations also suggest 
that the intensive rather than gradual 
training of reading has aversive aspects. 
Many children describe school and school 
activities as “work,” and in aversive terms. 
Although the language learning which 
takes place prior to school training is just 
as complex, and in these terms just as 
difficult to acquire, it is not described as 
being trying or difficult to the same extent 
as is formal training. The child does not 
say that he is having, or has had, a difficult 
time in learning to speak—or learning his 
extensive repertoire of discriminated ver- 
bal operants. 

In addition, to the extent that the 
school situation is aversive, it will be rein- 
forcing to “escape” the situation. Any 
behavior which removes the child from 
the aversive situation will be strength- 
ened. Thus, behaviors such as talking to 
other pupils, cutting up, doodling and 
playing quiet games, teasing other pupils, 
daydreaming, etc., will be strengthened by 
providing an escape from the aversive 
training situation. Of course, it is possible 
to make the behavior of leaving the situa- 
tion in these ways more aversive through 
punishment and, in this manner, main- 
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tain good participation in learning. Edu- 
cation in former times utilized these 
methods. 

It would seem, then, that there might 
be two ways to deal with the problems 
introduced by such an intensive training 
program. First, it should be possible to 
reduce the aversive nature of the onset of 
formal training by having it introduced 
considerably more gradually. In addition, 
the introduction of positive reinforcers 
into such an intensive program would 
change the situation in the direction of 
making it more positively reinforcing. To 
some extent, both of these developments 
have occurred in American education. 
Nursery schools, kindergartens, and read- 
ing readiness programs do make the 
training somewhat more gradual. In addi- 
tion, an attempt has been made to make 
learning more gamelike, lifelike, or “in- 
teresting” (ie., reinforcing) and less 
worklike (ie., aversive). These methods 
have sometimes been identified by the 
term “progressive” education. Unfortu- 
nately, it is well established that the acqui- 
sition of reading still forms a problem of 
training; the corrective measures taken 
thus far have not been adequate. 


Sources OF REINFORCEMENT FOR READING 
IN THE SCHOOL SITUATION 


A closer look at some of the sources of 
reinforcement available in the early school 
situation will indicate some of the remain- 
ing difficulties. To an extent dependent 
upon the child’s past history, the acquisi- 
tion of a new behavior (i.e., learning) may 
become reinforcing itself. That is, the 
stimuli produced by studying something 
and acquiring new “knowledge” (verbal 
behaviors) or “skills” (motor behaviors) 
will become secondary reinforcers if posi- 


tive reinforcers have been frequently 
paired with them in the past. It is tradi- 
tionally assumed that this type of rein- 
forcement should be present for all stu- 
dents, witness the old saw, “Learning is 
(or should be) its own reward.” Again, 
however, this cannot be counts. upon. 
Many children do not have a past history 
which has made learning itself reinfore- 
ing. When this is the case, it is ineffective 
simply to invoke the plea that learning 
should be reinforcing. 

The same thing occurs in making edu- 
cators and their approval secondary rein- 
forcers. For some children the teacher's 
attention and approval are strong reinforc- 
ing stimuli. Since these are learned rein- 
forcers, the extent to which they function 
as reinforcers will depend upon the past 
history of the child. If the child comes 
from a home which has not paired learn- 
ing with reinforcing stimuli, where educa- 
tion and educators have not become sec- 
ondary reinforcers, he would be said to 
have little “value” for education. The 
teacher’s approval would have scant rein- 
forcing properties in such a case. Unfor- 
tunately, many children would be ex- 
pected to have ineffective histories in this 
respect. 

In addition to the inadequacy of the 
teacher’s approval as a positive reinforcer 
for some children, there are other restric- 
tions upon the effectiveness of this source 
of reinforcement. In the school situation, 
reading training involves a group of chil- 
dren. To a large extent, this makes impos- 
sible the presentation of the reinforce- 
ment immediately contingent upon the 
behavior of the individual child. Only 
when the child recites individually may 
his behavior be immediately reinforced by 
other persons, and, of course, only a small 
proportion of school time will be occupied 
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with the behavior of any one child. Much 
of the work takes place in group study or 
group recital where no extrinsic reinforce- 
ment is involved. 

There are other reinforcers in the 
school program such as grades, special 
privileges, games, recesses, and the ap- 
proval of other students. In kindergarten 
the children are provided with toys, 
snacks, rest periods, television, and so on. 
These stimuli undoubtedly act as rein- 
forcers for some children. However, these 
reinforcers are seldom presented contin- 
gent upon correct reading behavior, and 
even when contingent they are not im- 
mediately delivered. In addition, most of 
the available reinforcing stimuli are heavy- 
weight reinforcers which are delivered all 
at one time, whereas the behavior in- 
volved consists of numerous responses, a 
good proportion of which should be in- 
dividually reinforced. 

The reinforcers available in the school 
situation may vary from child to child. 
And, for some children there may be only 
weak reinforcers which are made contin- 
gent upon his reading behavior. In addi- 
tion, there is a “snowballing” effect, since 
the child for whom there are only weak 
reinforcers in the school situation learns 
to read very slowly. Because he accom- 
plishes little, he receives less reinforce- 
ment contingent upon his classroom per- 
formance, and his behavior becomes 
telatively weaker. It may be concluded 
that, as compared to speech learning in 
everyday life, learning to read occurs in a 
situation much less favorable in terms of 
the application of reinforcement princi- 
ples. It would thus be expected that many 
failures would occur in the development 
of this vital repertoire of behaviors. 

One final point. If positive reinforcers 
available in the school situation are weak 


or ineffectively applied, then the behav- 
iors which are prerequisites to the acquisi- 
tion of reading will not be maintained. To 
acquire reading behavior, the child must 
first respond by looking at the words and 
letters and then by making the appropri- 
ate verbal responses to the prompts of the 
teacher. If these prerequisite behaviors, 
which in everyday terms are called the 
attention of the child, are extinguished 
through lack of sufficient reinforcement, 
then further progress in learning to read 
ceases. Such a child would not acquire 
proper reading behavior even though pres- 
ent in class during appropriate training. It 
would certainly be erroneous to conclude 
in such a case that the child had some 
physical defect. 

A summary of the important points in- 
volved in this section might be as follows. 
First, the onset of an intensive training 
program in reading is relatively sudden 
and may involve a good deal of aversive- 
ness. In addition, there are only weak 
sources of reinforcement for many chil- 
dren in the training situation, Further- 
more, the reinforcers which are available 
are not made immediately contingent 
upon the many “reading responses” in- 
volved. Finally, if adequate reinforcement 
for the child is not available in the read- 
ing program, the behaviors which are pre- 
requisites for the acquisition of reading 
may extinguish. If this happens, progress 
in learning to read will cease. 


Implications for Research 


It becomes evident from this compari- 
son that there are important implications 
for understanding some of the special 
problems encountered in learning to read 
and for conducting research on reading 
acquisition. Although it is not within the 
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scope of this paper to outline a research 
program based upon the present analysis, 
a few examples can be given to indicate 
the type of research which might be de- 
rived. 

The rationale which suggests applica- 
tions to a study of reading can be stated in 
the following points: 

1. If the prerequisite behaviors of at- 
tending to and working at the acquisition 
of speech responses to visual verbal stim- 
uli are not reinforced they will extinguish. 

2. The more intensive the training, the 
more aversive such training becomes. 

3. This aversiveness will act as a strong 
negative reinforcer, and incompatible be- 
haviors which remove the child from the 
aversive situation (absenteeism, cutting 
up, daydreaming, etc.) will increase in fre- 
quency. 

4. The use of positive reinforcers, im- 
mediately contingent upon the prerequi- 
site behaviors involved in the acquisition 
of reading, could prevent the extinction of 
these behaviors and prevent or reverse the 
learning of incompatible behaviors. 

5. Reinforcement of reading would also 
make this behavior itself become posi- 
tively reinforcing. 

6. As a consequence of the use of rein- 
forcement for reading, very rapid learning 
should occur. 

These points strongly suggest that read- 
ing learning should be studied in a pro- 
cedure involving the immediate applica- 
tion of positive reinforcers for attending 
to and working at the acquisition of tex- 
tual responses. Experimenters are already 
studying the possibilities of shaping sim- 
ple behaviors in children through the use 
of various reinforcers (2). Trinkets, tokens, 
money of small value, toys, music, snacks, 
approval, and so forth, have been used in 
various combinations. The results indicate 


that the principles discussed herein are 
applicable to the training of children and 
therefore they should be applicable to the 
significant area of reading.’ 

From such study the basic principles 
involved in learning to read could be de- 
termined, and the information obtained 
would be important for application to the 
establishment of future training programs. 
Such research would be a direct out- 
growth of this type of analysis concerning 
the application of behavior principles to 
the area of reading development. 

Further study must be made of the 
possible use of existing sources of reinforce- 
ment. The snacks, toys, recesses, etc., 
usual in the kindergarten are strong rein- 
forcers, but they are not made specifically 
contingent upon the behavior which is to 
be developed. This might be possible, how- 
ever, through the use of a token system 
where the token was made contingent 
upon the behavior to be strengthened. 
The tokens could be established as sec- 
ondary reinforcers by being paired with 
the reinforcers already available in the 
situation. 

It may be said that there are practical 
restrictions involved in the use of individ- 
ually applied reinforcers in a teaching sit- 


3 Results of the Reading Research proj- 
ect described in the first footnote, which 
will be reported in detail at a later time, 
indicate that reading behaviors are rapidly 
acquired where reinforcers such as these are 
used and that the learning situation is re- 
sponded to more favorably by the pupils, 
i.e., exceptional work habits and attention 
are obtained from even very young children 
(4 years old). The individual subjects who 
have been studied (16) produce operant 
conditioning curves which are sensitive to 
the presentation and withdrawal of the 
extrinsic reinforcers, as would be expected 
on the basis of operant conditioning prin- 
ciples. 
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uation. Teacher time in a more individ- 
ualized program might be excessive. In 
addition, some people might oppose the 
use of extrinsic reinforcers in the training 
of children. However, a priori judgments 
such as these are not justified. Before 
practical circumstances can be adequately 
evaluated, it is necessary to understand 
the principles of behavior which are in- 
volved in language learning and to have 
empirical results upon which to make de- 
cisions. 

Actually, these types of objections may 
prove to be unwarranted once a program 
of the type described has been developed 
for reading training. For example, it might 
be possible to mechanize the training pro- 
gram, including the delivery of reinforcers. 
Recent successes with automated teaching 
devices, even without the use of extrinsic 
reinforcers, indicate this as a likely pos- 
sibility (4). 

In addition, with the rapid learning 
which the use of reinforcement would 
promote, perhaps only a short program 
would need to be involved until the ap- 
propriate reading units are acquired. That 
is, perhaps an intensive program of rein- 
forcement is necessary only until units of 
verbal responses (e.g., syllable and letter 
responses) come under the control of ap- 
propriate visual stimuli. Once this has oc- 
curred, the child will be able to read 
many different words the first time they 
are presented and less supervision would 
be necessary for further progress. Thus, it 
might be more effective to spend time 
with the individual child in the early 
phases of reading training than to prolong 
less effective training which proceeds 
slowly and produces many failures. Only 
research of the suggested type will provide 
this information. 

Along this line, it should be pointed 


out that learning the initial behaviors in- 
volved in reading has intrinsic value only 
if the child has been trained in such a 
manner that learning is reinforcing. Other- 
wise, acquiring reading responses involves 
a great deal of effort or “work,” i.e. it is 
not reinforcing. Once the unit speech re- 
sponses have been well acquired, however, 
the same amount of work is not involved. 
Then reading has the same reinforcing 
value as being told a story. At this point 
it would not be necessary to continue the 
frequent extrinsic reinforcement of read- 
ing behaviors. (A more detailed analysis 
of this rationale is available, but is not 
presented at this time.) 

It is also possible that a one-to-one ratio 
of student to teacher using a program in- 
cluding extrinsic reinforcers would be 
appropriate for working with special pop- 
ulations of children, e.g., retarded chil- 
dren, deaf or blind children, remedial 
readers, etc. Learning here could be 
strongly accelerated and make the one-to- 
one relationship practical, especially since 
the type of program which may emerge 
would not require highly trained individ- 
uals as administrators. It would be ex- 
pected that the program would be espe- 
cially pertinent for retarded children, since 
much of their learning problem probably 
involves the weak and slow learning of 
secondary reinforcers. 

These are all issues which can only be 
resolved by conducting appropriate re- 
search. An understanding of the behavior 
principles involved in language learning 
indicates what some of the lines of re- 
search should be. Through this type of 
analysis and research it is hoped that the 
findings of general psychology and the 
practical problems of child development 
and education can be brought into a use- 
ful relationship. 
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Social Conditioning 
of Vocalizations in the Infant* 


Harriet L. Rheingold, Jacob L. Gewirtz 
and Helen W. Ross 


By three months of age the infant gives 
a well-defined social response to the ap- 
pearance of adults. He looks at them 
intently, smiles, becomes active, and vo- 
calizes, This behavior is repeated again 
and again in sequence. Adults often re- 
spond to these acts of the infant; they 
may only look at the child, but they may 
also smile to him, touch or caress him, or 
vocalize in return, Frequently one ob- 
serves “answering” social and, in particu- 
lar, vocal play between mother and child. 
The adults’ responses may therefore play 
an important part in maintaining and de- 
veloping social responsiveness in the child 
(Rheingold, 1956). The principles of 
operant conditioning (Skinner, 1953) 
suggest that some of these adult re- 
sponses, functioning as reinforcers, may 
affect the development of the child’s so- 


*From H. L. Rheingold, J. L. Gewirtz, 
and H. W. Ross, Social conditioning of 
vocalizations in the infant, J. comp. 
physiol. psychol., 52, 68-73 (1959). Re- 
printed by permission of the authors and 
the American Psychological Association. 


cial behavior (Gewirtz, 1956). Thus, 
smiling in the infant has been shown to 
respond to conditioning (Brackbill, 
1958). 

The present study was an attempt to 
condition vocalizations in infants, Vo- 
calizations were selected for study because 
they seem to provide an index of the 
whole social response (Rheingold, 1956). 
The reinforcing stimulus was a complex 
of social acts which resembled those an 
attentive adult might naturally make 
when a child vocalizes. If temporal con- 
tiguity between the infant’s vocalization 
and the reinforcing stimulus, which fol- 
lows it, brings about an increase in the 
vocalizations, conditioning may be said to 
have occurred. The possibility that the 
reinforcing stimulus may also have func- 
tioned as an arouser of vocalizations will 
be considered. In any case, the results of 
the study should provide further under- 
standing about the development of social 
responsiveness, as well as of speech. 


Method 


Two parallel experiments were carried 
out in sequence. In the first, 11 babies 
(Ss) were studied, with one experimenter 
(E) and one observer-recorder (O), both 
women. In the second, 10 other Ss and 
one S from Experiment I were studied 
with the E and O of the first experiment 
exchanging roles, An experiment was com- 
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posed of three successive units in each of 
which three or four Ss were studied at one 
time, 


SUBJECTS 


The Ss were 21 infants, all residents 
almost from birth in the same institution. 
(We are grateful to Sister Thecla and the 
staff of St. Ann’s Infant Asylum, Wash- 
ington, D.C., for their generous coopera- 
tion.) Their median age was 3.0 months; 
three-quarters of them were no more than 
three days older or younger than the 
median. In each experiment six Ss were 
male, five were female. Age was the main 
criterion for selection. Four possible Ss 
were rejected: one seemed immature, two 
had a very high rate of vocalizing during 
the first baseline measure, and one was 
markedly fussy. 

The institution offers excellent care 
and, as is characteristic of institutions, 
there are multiple caretakers. In general, 
the Ss were well developed, healthy, alert, 
and socially responsive. The Es asked for 
no modifications in the usual caretaking 
routines. The caretakers knew that the 
Es were observing the development of 
social behavior, but they did not know 
the details of the experiment. The care- 
takers’ usual behavior toward the Ss ap- 
peared not to be modified by the condi- 
tions of the experiment. 


EXPERIMENTAL CONDITIONS 


Baseline 


In experimental Days 1 and 2 (first and 
second Baseline days) E leaned over the 
crib with her face about 15 in. above S’s 
and looked at him with an expressionless 
face, while O tallied vocalizations, out of 
S’s sight. The E moved her head as neces- 
Sary to remain in S’s line of vision, a con- 


dition which obtained throughout the ex- 
periments. 


Conditioning 


During experimental Days 3 and 4 
(first and second Conditioning days), E 
again leaned over the crib with an expres- 
sionless face except that when S vocalized, 
E made an immediate response and then 
resumed the expressionless face until the 
next vocalization. The response, or rein- 
forcing stimulus, consisted of three acts 
executed by E simultaneously, quickly, 
and smoothly. They were a broad smile, 
three “tsk” sounds, and a light touch 
applied to the infant’s abdomen with 
thumb and fingers of the hand opposed. 
No more than a second of time was re- 
quired to administer the reinforcer. 

At the beginning of the conditioning 
periods each vocalization was reinforced. 
Sometimes, as the rate of vocalizing in- 
creased, only every second, and later, every 
third, vocalization was reinforced. In Ex- 
periment I, 72% of the reinforcers oc- 
curred after each vocalization; in Experi- 
ment II, 94%. Less frequent reinforcing 
seemed to depress the rate, at least ini- 
tially, and, because of the rather severe 
time restrictions, was abandoned alto- 
gether by the end of the study. 


Extinction 

Experimental Days 5 and 6 (first and 
second Extinction days) were the same as 
Days 1 and 2; E leaned over the crib with 
an expressionless face and made no re- 
sponse to S’s vocalizations. 


Tue Vocat RESPONSE 


Every discrete, voiced sound produced 
by S was counted as a vocalization. A 
number of other sounds characteristically 
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made by very young infants, e.g., straining 
sounds and coughs, and the whistles, 
squeaks, and snorts of noisy breathing, 
were not counted as vocalizations. Sounds 
falling under the categories of protests, 
fusses, and cries (see Emotional Behavior 
below) were recorded separately. No at- 
tempt was made to record the phonetic 
characteristics of any of the sounds or 
their duration. 


Observer agreement 


Agreement between two Os on the 
number of vocalizations produced by Ss in 
3-min. periods was high. Counts for 27 
periods, using 13 different Ss, yielded a 
median percentage agreement of 96 
(range, 67 to 100). About half of these 
reliability measures were obtained at the 
Ss’ cribs, and the rest from tape recordings 
made during the experiment. These two 
techniques yielded similar percentages of 
observer agreement. 


The unit of measurement 


The unit for statistical analysis was the 
number of vocalizations an S gave in a 3- 
min, period. The counts were recorded by 
half-minutes and these were summed to 
give the score for the 3-min. period. After 
a rest period of 2 min., in which both E 
and O walked away from the baby’s crib, 
another 3-min. count was made. After a 
second rest period a third count was 
made. 

In each day nine such 3-min. counts 
were planned, distributed thus: one block 
of three in the first part of the morning, 
the second block of three in the late 
morning, and the third block of three 
after the midday meal. The minimum 
amount of time between blocks was 10 
min., although usually an hour or more 
elapsed. 


Actually, nine periods of observations 
were obtained during only 80% of the 132 
subject-days (22 Ss x 6 experimental 
days). Since three or four Ss were studied 
at a time, it was not always possible to 
find nine periods in a day when each was 
awake, alert, and content. Further, be- 
cause the experiments were carried out in 
the nursery which the Ss shared with 12 
other infants, the presence and activities 
of these other babies, and of the care- 
takers in carrying out their routines, some- 
times made it impossible to obtain the 
desired number of periods. 


EMOTIONAL BEHAVIOR 


A number of responses which seemed 
to be “emotional” were recorded during 
the observation periods. These were: “pro- 
tests,” discrete sounds of a whining na- 
ture; “fusses,” a series of sounds separated 
by a catch in the voice, whimpering; 
“cries” continuous loud, wailing sounds; 
“persistent looking away from E,” rolling 
of the head from side to side or staring to 
one side or the other of E; and “marked 
hand activity,” hand play, finger sucking, 
or face or head rubbing. The last two 
activities seemed to be attempts to avoid 
E. Measures of observer-agreement in the 
recording of these responses were not 
made. 

Each of these responses was given a 
credit of one for each half-minute in 
which it occurred. From the sum for each 
S a mean score was obtained for each 
experimental day. 


Results 
SIMILARITY BETWEEN EXPERIMENTS 


Figure 1 presents the means of both 
experiments for the six experimental days. 


MEAN NUMBER OF VOCALIZATIONS 
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Each point represents the mean of 11 
individual means. It was expected that 
the effect of the experimental conditions 
would be similar from experiment to ex- 
periment, but the extent to which the 
slopes of the curves would be congruent 
was not predicted. 

The amount of similarity between the 
two experiments was estimated by an 
analysis of variance (Table 1), using Lind- 
quist’s Type VI design (1953). The an- 
alysis reveals no evidence of a difference 
between Experiments. Further, no source 
of variation involving Experiments is 
significant. (The difference between the 
two experiments in second Extinction 
day means is not significant; it suggests, 
however, that the less frequent reinforce- 
ment in Experiment I may have made the 
behavior more resistant to extinction.) 

Three conclusions may be drawn from 
such close agreement in the results of two 
parallel experiments, each using different 
Ss and different Es: first, we are dealing 
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FIG. 1. Mean number of vocalizations on 
consecutive experimental days. From 
Rheingold, Gewirtz, and Ross: Social 
conditioning of vocalizations in the in- 
fant. 
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with some relatively stable characteristics 
of three-month-old infants; second, the 
results may be accepted with confidence; 
and third, the results of the separate ex- 
periments may be pooled for all remain- 
ing analyses. 


EFFECT OF EXPERIMENTAL CONDITIONS 


Table 1 shows that there was a differ- 
ence in the effect of the three two-day 
experimental conditions (p < .001), and, 
also, in the effect of successive days within 
conditions (p < .001). These effects were 
assessed by t tests (for paired data) on 
the amount of change from one day to 
another in the mean number of vocaliza- 
tions given by individual Ss. The error 
term was derived only from the scores for 
the two days being compared. The tests 
on the pooled sample (21 df) show that: 

1. There was no statistically significant 
difference in the mean number of vocali- 
zations given in a 3-min. period from the 
first to the second Baseline day (t = 0.87, 
p > 30). 

2. The mean number of vocalizations 
increased from the second Baseline day 
to the first Conditioning day (t= 2.69, 
p < 01). 

3. A further increase occurred from the 
first to the second Conditioning day (t = 
3.61, p < .001). 

4, On the first Extinction day, vocaliza- 
tions decreased (t = 3.19, p < .0025). 

5. The mean number of vocalizations 
on the second Extinction day was smaller 
than on the first Extinction day, but the 
difference was not reliable (t = 1.35, p < 
10). 

é There was no statistically significant 
difference between the mean number of 
vocalizations given on the second Extinc- 
tion day and on the second Baseline day 
(t = 1.20, p > .20). 

The tests between Baseline days and 
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TABLE 1 
Analysis of Variance of Effect of Consecutive Experimental Days 


SOURCE OF VARIATION df MS F 
Between Subjects 21 
experiments (1 vs. 2) 1 1218 0.03 
error 20 45322 
Within Subjects 110 
conditions (Baseline vs. condi- 
tioning vs. extinction) 2 71243 (1)8 10.63* 
days within conditions (1 vs. 2) 1 4205 (2) 1.88 
conditions X days 2 22917 (3) 9.24* 
days X experiments 1 1738 (2)8 0.78 
conditions X experiments 2 2031 (1)8 0.30 
conditions X days X experiments 2 866 (3) 0.35 
error 1 40 6703 
error 2 20 2233 
error 3 40 2481 


aLa 
a Number in parentheses refers to the error term used. The terms were not 
pooled because of statistically significant differences among them, 


* Significant at .001 level. 


From Rheingold, Gewirtz and Ross: Social conditioning of vocalizations in the 


infant. 


between Baseline and Extinction days 
were two-sided tests; the others were one- 
sided. 

If final days within conditions are com- 
pared, the differences are more marked: 
the mean for the second Conditioning 
day is higher than that of the second Base- 
line day at p < .0005 (t = 4.80), and the 
second Extinction day mean is lower than 
the second Conditioning day mean at 
p < -0005 (t= 4.08). Similar differences 
occur between the means of experimental 
conditions, obtained by averaging the 
first- and second-day results for each con- 
dition. 

AMOUNT OF CHANGE IN NUMBER 
OF VOCALIZATIONS 


The treatment effects have been found 
reliable. It seems in order, therefore, to 
present the means of vocalizations for 


each day and to calculate the amount of 
change produced by the experimental 
conditions. Under baseline conditions the 
three-month-old infants gave about 13 to 
14 vocalizations in a 3-min. period. In- 
dividual differences were wide and ranged 
from 3 to 37 vocalizations. Using the 
social reinforcer for one day raised the 
rate to 18 vocalizations, an increase of 
39%. A second day of conditioning ele- 
vated the rate to 25, a further increase of 
34%. In all, conditioning brought about 
an increase of 86%. Removing the rein- 
forcer depressed the rate to 17 during the 
first and to 15 during the second day, the 
latter approaching very closely the level of 
baseline performance. 


EMOTIONAL BEHAVIOR 


Emotional behavior, while striking 
when it occurred, was observed infre- 


SOCIAL CONDITIONING OF VOCALIZATIONS IN THE INFANT 87 


quently. The largest mean for any day in 
both experiments was 3.0, the smallest 
was 1.9. The order of the means by ex- 
perimental days was identical in the two 
experiments. It was: first Extinction day, 
second Extinction day, second Baseline 
day, second Conditioning day, first Con- 
ditioning day, and first Baseline day. The 
greater number of emotional responses 
during Extinction agrees with the findings 
of others (e.g, Brackbill, 1958; Skinner, 
1953; Verplanck, 1955). Because the re- 
sponses labeled emotional occurred so in- 
frequently and because observer-agree- 
ment measures were not made, no further 
statistical analysis seemed warranted. 


ADDITIONAL FINDINGS 


Performance of successive groups. It 
will be recalled that in any one experi- 
mental week the Ss were studied in groups 
of three or four. Inspection of the results 
suggests that in each successive group of 
each experiment an increasing number of 
Ss conformed to expectation, showing an 
increase in vocalizations during Condi- 
tioning and a decrease during Extinction. 
The Es apparently became more adept in 
executing the reinforcer as each experi- 
ment progressed. 


PERFORMANCE OF INDIVIDUAL SUBJECTS 


Although differences between experi- 
mental conditions have been demon- 
strated for the Ss as a group, the perform- 
ance of individual Ss is of interest. Of the 
22 Ss, 19 showed an increase in vocaliza- 
tions under Conditioning. For 14 of these 
19 the increase was significant at the .05 
level, according to the Mann-Whitney 
Test (1947). Under Extinction, 16 of the 
22 Ss showed some decrease, and for 10 of 
these 16 the decrease was significant at 
the .05 level. 


Three Ss departed widely from the 
group pattern. For two, not only did Con- 
ditioning depress the rate of vocalizing, 
but Extinction restored it to its Baseline 
rate. The first chewed her thumb more 
during Conditioning than before or after. 
The second strained (in an apparent ef- 
fort to defecate) during Conditioning 
whenever anyone, E or the nurse, leaned 
over his crib. Both activities precluded 
vocalizing. Both babies were very active, 
and it is possible, therefore, that in the 
very first Conditioning period E may have 
inadvertently reinforced these activities. 
For the third S, in Experiment I the ex- 
perimental conditions appeared not to 
affect the frequency of vocalizations. De- 
velopmental immaturity seemed the most 
likely reason, for two weeks later he was 
studied again in Experiment II (the only 
S to be used in both experiments) with 
satisfactory results. 


EFFECT OF BASELINE PERFORMANCE 
UPON CONDITIONING 


The Ss tended to maintain their rela- 
tive positions under Baseline and Condi- 
tioning. The rank-order coefficient of 
correlation (R) was .66, p < .0005. Fur- 
ther, the amount of gain under Condi- 
tioning was not correlated with original 
position (R = .24, p > .05). 

Sex differences. The 12 male Ss gave 
slightly more vocalizations during Base- 
line and gained more under Conditioning 
than the 10 female Ss, but the differences 
were not reliable. 


DISCUSSION 


The results of these experiments sug- 
gest that: 

1. Infants’ vocal behavior in a social 
situation can be brought under experi- 
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mental control; that is, it appears to be 
conditionable. 

2. A social event composed of an 
everyday complex of acts, performed by 
an adult who is not a caretaker, can func- 
tion as a reinforcing stimulus. 

3. The incidence of such behavior can 
be very quickly modified in as young an 
organism as the three-month-old infant. 


ALTERNATIVE EXPLANATION 


The question raised in the introduction 
may now be considered. Did the rein- 
forcing stimulus function as an arouser of 
vocalizations? Would infants have vo- 
calized more often because of the stimu- 
lation it provided, even if it had not been 
made contingent upon the infant’s be- 
havior? Or, did some part of the reinfore- 
ing stimulus (say, the smile) act as a 
social “releaser”? The findings appear to 
be compatible with the conclusion that 
conditioning occurred: The rate of vocal- 
izing continued to rise on the second day 
of Conditioning; the rate did not fall to 
the Baseline level on the first day of 
Extinction; it continued to fall on the 
second day of Extinction; and Ss with low 
Baseline rates of vocalizing gained under 
Conditioning, although for them there 
was often a relatively long time interval 
(30 sec. or more) between the reinforcing 
stimulus and the occurrence of the next 
vocalization, Still, thé decisive answer to 
the question must await an experiment 
in which the reinforcing stimulus is ad- 
ministered with equal frequency, but 
never directly after the infant vocalizes. 


NATURE OF THE REINFORCER 


The results seem to show that some 
everyday behavior of adults can function 
as a reinforcing stimulus for an infant. 
One would like to know from what 


sources its reinforcing properties arise. In 
the simplest case, the smiles, sounds, and 
caresses of adults may be reinforcing only 
because they provide a change in stimula- 
tion. Further information on this matter 
could be obtained by working with the 
separate parts of the reinforcing stimulus, 
one by one; by substituting for them 
lights or sounds dispensed by a machine; 
or by using a reinforcer of a less “affec- 
tionate” nature than the one used here 
appears to be. On the other hand, even 
for the three-month-old infant the smiles, 
sounds, and caresses of the adults may 
function as conditioned reinforcers be- 
cause of their past association with care- 
taking acts. 

It is possible that the Ss of this study, 
living in an institution, may have had a 
less rich experience with adults. Institu- 
tional babies were used as Ss only because 
they were more readily available, because 
more of them could be studied at one 
time, and because the complicating vari- 
able of differences in maternal care could 
be bypassed. They did not appear however 
to be “starved” for attention or affection. 
Indeed, the attendants were often ob- 
served responding to babies when they 
vocalized. While it is possible that 
mothers would respond more often, in the 
absence of a comparative study we believe 
that infants in general would respond as 
these infants did. 


RELATION or RESULTS 
TO THEORIES OF SPEECH 


Since this study was limited to the 
vocalizing of infants in a social situation, 
attempts to reconcile the results with 
theories which account for all classes of 
prelinguistic utterances (babbling is the 
class frequently mentioned) cannot be 
complete. Thus, nothing in the findings 
of this study is incompatible with, for 
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example, Holt’s theory (1931) that the 
sound which the child hears himself make 
has reinforcing properties; with Lewis’ 
theory (1951) that the adult’s speech calls 
forth the infant’s speech (a kind of imi- 
tation); or with Piaget’s theory (1952) 
that vocalizing is perpetuated for its own 
sake by the processes of assimilation and 
accommodation. These may be labeled 
circular theories, for they do not postulate 
the necessity for any class of events prior 
to the moment when the infant responds 

his own or another's vocalization. The 


ories of Miller and Dollard (1941) 
and of Mowrer (1950), on the other 
hand, are based upon the infant’s associat- 
ing the gratification of his needs and the 
accompanying vocalizations of the care- 
taker. Again, the results do not contradict 
this possibility. 

The present study, however, does dem- 
onstrate the operation of still another 
principle: that the speech of the infant, if 
only in a social situation, can be modified 
by a response from the environment 
which is contingent upon his vocalizing. 
Hence, what happens after the infant vo- 
calizes has been shown to be important. 


SIGNIFICANCE OF RESULTS 


On the basis of the results of these 
experiments it is seen that responses of 
adults which do not involve caretaking 
can affect the vocalizing of the young in a 
social setting. If the results can be ex- 
tended to life situations, then mothers 
might be able to increase or decrease the 
vocal output of their children by the 
responses they make when the children 
vocalize, Other kinds of social behavior 
in addition to vocalizing behavior should 
respond similarly to conditioning. Brack- 
bill (1958) has shown that smiling in the 
four-month-old infant may be increased 
when followed by a social response from 


an adult. It is likely that still other kinds 
of social behavior in babies, such as show- 
ing an interest in people, reaching out to 
them or turning away, perhaps even fear 
of the stranger, may also be affected by 
the responses adults make to them. 


SUMMARY 


Infants often vocalize as part of the 
response they give to the appearance of 
an adult. The central question of this 
study is: Can the frequency of vocalizing 
be increased if the adult makes a social 
response contingent upon it? 

The Ss were 21 normal infants, three 
months of age, living in an institution. 
Eleven of them were studied in Experi- 
ment I with one E; 10 different Ss and 
one S from Experiment I were studied in 
Experiment II with a different E. 

During the first and second Baseline 
days E leaned over S with an expression- 
less face, and the number of vocalizations 
was tallied. During the next two days, the 
first and second Conditioning days, E re- 
inforced vocalizations by simultaneously 
smiling, clucking, and touching S’s abdo- 
men. During the last two days, the first 
and second Extinction days, E returned 
to Baseline conditions. 

The results indicated that: (a) there 
was no difference between Experiments, 
(b) Conditioning raised the rate of vocal- 
izing above the Baseline level, (c) while 
Extinction lowered it until it approached 
the Baseline level. 

The results suggest that the social vo- 
calizing of infants and, more generally, 
their social responsiveness may be modi- 
fied by the responses adults make to them. 
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%1,2 


Although there is a fairly large litera- 
ture concerned with the objective de- 
scription of language in children (4), the 
categories used for such description, as 
well as the response units chosen for cate- 
gorization, have been strictly empirically 


of the Office of Education, the United 
States Department of Health, Education, 
and Welfare, and partially supported by a 
grant from the Taconic Foundation to the 
Institute for Developmental Studies. 

2 Biometrics Research, New York State 
Department of Mental Hygiene and Co- 
lumbia University. This study was sup- 
ported in part by Research Grant M1541 
from the National Institute of Mental 
Health of the National Institutes of 
Health, Public Health Service. 


OPERANT CONDITIONING OF CONTINUOUS SPEECH gl 


derived. Usually no theoretical back- 
ground is used as a guide for the formula- 
tion of such categories or for the defini- 
tion of the response units. One exception 
is Piaget (5) who does in fact make use 
of a theoretical framework for collecting 
information about speech development. 
However, his methods of experimentation 
are such that the response unit is never 
defined and would seem to be as much a 
function of the experimenter as the child. 
Another exception has been the work of 
Berko and Brown (1), who have made an 
excellent start in developing experimental 
techniques based on psycholinguistics for 
the purpose of eliciting verbal behavior 
from children in order to gain informa- 
tion about language structure. This work 
is a good example of a situation in which 
theory specifies the variables to be ex- 
plored. Recently, Rheingold, Gewirtz, 
and Ross (6) conducted a study evolving 
from behavior theory in which they used 
operant conditioning techniques to con- 
trol vocalization rate in infants. They 
found differences in vocalization rate as a 
function of reinforcement. The adminis- 
tration of reinforcing stimuli produced an 
increase in rate and the withdrawal of 
such reinforcing stimuli produced a de- 
crease in rate. This indicates that the 
stimulus conditions operating while sam- 
ples of vocalizations are being taken are 
critical for evaluating the results. Such 
stimulus conditions have seldom been 
adequately controlled in developmental 
studies on infant vocalization. Studies of 
speech acquisition with older children 
have lacked the same controls as the in- 
fant surveys. 

One of the problems in speech sam- 
pling has been that of the length of the 
samples. Usually results have been based 
on short samples, e.g, answers to inter- 


viewer questions on vocabulary tests or 
timed observations during free play situa- 
tions. Furthermore, responses are gener- 
ally not tape recorded, thereby barring 
the application of any reliability estimates. 

The many studies of verbal behavior 
originating within the framework of oper- 
ant conditioning (3, 7) have shown that 
the emission of verbal responses can be 
experimentally controlled by means of re- 
inforcement. Also, as has been suggested 
by Salzinger (7), examination of the ef- 
fects of the application of reinforcement 
to any response class, i.e, a group of 
words which is chosen and specified by 
the experimenter should allow us to test 
for the “natural” boundaries of that class, 
i.e, those words which actually do in- 
crease in frequency and those which do 
not. In this way it becomes possible to 
determine if there are any discrepancies 
between the response class as arbitrarily 
defined by the experimenter and the way 
the subject’s verbal behavior actually 
changes as a result of reinforcement 
These “natural” classes may prove more 
useful as a developmental index than 
response classes prescribed by the experi- 
menter. 

The use of operant conditioning tech- 
niques in conjunction with special in- 
structions has recently proved successful 
in evoking long samples of continuous 
speech (monologues) from schizophrenic 
adult patients (11). In the study to be 
reported below, a similar technique was 
used successfully to elicit samples of con- 
tinuous speech from normal children. 
Factors relating to reinforcement sched- 
ule and response class were also dealt 
with. 

A series of five experiments was con- 
ducted. The first was carried out as an 
exploratory study and concerned the ques- 


92 Verbal Behavior 


tion of whether speech rate could be 
modified by reinforcement. The second 
experiment tested the effect on speech 
rate of a specific type of reinforcement 
schedule, a variable ratio schedule. The 
third experiment was performed as a 
more extensive study on a different popu- 
lation in order to verify the results found 
in the first two studies, as well as to pro- 
vide information on the effect of a fixed 
interval schedule on speech rate. The 
fourth experiment was carried out on the 
same population as the third, in order to 
examine the effects of reinforcement on a 
preselected specific response class. The 
fifth was done as a control study to see if 
changes in speech rate occurred in the 
absence of reinforcement. 


Method 
APPARATUS 


The apparatus constructed for the de- 
livery of reinforcement was a papier- 
mâché clown’s head approximately 18 in. 
high, the nose of which was a 7%4-watt 
red light bulb. This was mounted on a 
wooden stand and placed in a colorful 
box. The light could be switched on and 
off by the experimenter (E), and its 
occurrence was determined by different 
schedules of reinforcement. The click of 
the light switch was sufficiently loud to 
be tape recorded. 

A tape recorder was used to record the 
child’s speech as well as to deliver taped 
instructions to the child “from the 
clown.” 

During the last two experiments, a 
large burlap screen was placed on the 
table between the clown and the tape 
recorder in order to prevent completely 
the children from viewing either the re- 
cording apparatus or the two Es. During 


the first two studies the Es were partially 
hidden behind the clown’s box. Although 
there was no evidence to suggest that the 
results of the first two studies were af- 
fected by the lack of screen, it was felt 
that the use of a screen might offer adde 
control over the experimental conditions. 

A stop watch was used to time the de- 
livery of reinforcements. 

Small toys were given as a final rein- 
forcement after completion of each 
session. 


PROCEDURE 


Experiment I. 


The sample consisted of nine children 
ranging in age from 5 to 7 years, from a 
private day nursery.* 

Each child was brought into the experi- 
mental room, seated at a small table, and 
asked to draw a picture, first, of anything 
he wanted and then, of a clown. All his 
productions were verbally approved by E, 
in order to reinforce the emission of 
speech in the general situation. 

The child was then told that the clown 
he had just drawn resembled one which 
had come to see him. He was then seated 
in front of the papier-maché clown and 
told that the clown would speak to him. 

The clown then partly sang, partly 
spoke the following tape recorded instruc- 
tions: 


I’m so happy. I’m so happy. I’m so ha-pa- 
pa-ha-pa-pa- happy (clown’s nose lights up). 
Whoops, well hi there. My name is Happy 
(light). What’s yours? (waits for child’s 
reply). That’s a nice name. Say, how do you 
like my new hat? (waits for reply). Well, 


3 Thanks are due to Paul Tucker of the 
Flushing Progressive School for supplying 
us with nursery school subjects. 
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you know, I bought the hat especially for 
you boys and girls at this school. I’m so 
happy to be here (light). How do you like 
that! Every time I’m happy my nose lights 
up (light). Say, would you like to play a 
game with me? (waits for reply). Because 
we can have lots of fun together. Why don’t 
you try to make me happy so my nose lights 
up? (light). All you have to do is talk to me, 
but only certain things you say will make me 
happy (light). You can tell me a story. You 
can tell me what you’d like to be when you 
grow up, what you do here in school, about 
your friends, and anything else you want to 
say to me. If you make me very very happy 
(light), you will get a special prize at the 
end of the game. See them over there? Now, 
do you understand the rules of the game? 
(waits for reply). You're supposed to talk to 
me and try to make me happy by getting 
my nose to light up (light). From now on, 
I'm not going to say anything. I’ll only light 
up when you make me happy (light). Now 
you just wait a little bit and one of my 
assistants will tell you when to start. Okay? 


The purpose of flashing the light when- 
ever the clown said, “happy,” was to 
establish the association between the 
light and the clown’s being happy. 

Two Es sat partially hidden behind the 
clown’s box. The child was told to begin 
and, once he started talking, E reinforced 
the child’s speech by lighting up the 
clown’s nose according to a prearranged 
schedule. 

‘There were three experimental periods: 
conditioning (ranging from 3 to 5 min- 
utes), extinction (ranging from 1 to 3 
minutes), and reconditioning (ranging 
from 4 to 5 minutes). During the first 
minute of the first conditioning period all 
speech was reinforced on a 2-second fixed 
interval schedule. This provided almost 
continuous reinforcement for the begin- 
ning of the session. During the remaining 
conditioning periods the response class 
was intermittently reinforced. It was de- 
fined to consist of all statements which in- 


cluded references to persons and pronouns 
(including references made to clowns and 
the child himself). 

Prods were administered by E when- 
ever the child ceased talking. Examples of 
the prods used were, “keep talking to the 
clown; try to make him happy; tell the 
clown a story; tell him something about 
your friends.” Three out of nine children 
required prodding. The others spoke con- 
tinuously until the end of the session. 

Following the experimental session each 
child was given a small gift. 


Experiment IT 


The sample consisted of seven children 
ranging in age from 5 to 6 years, who 
were taken from the same private nursery 
school as those in experiment I. 

Each child was brought into the experi- 
mental room, seated at a small tabie, and 
read a story from a large colored picture 
book. The story and illustrations were 
devised specifically for the experiment 
and concerned a clown who was made 
happy only when children spoke to him. 
E asked the child questions about the 
story and reinforced all his replies by say- 
ing “mm-hmm,” “that’s right,” etc. 

The child was then seated in front of 
the clown and given the same tape re- 
corded instructions as used in experiment 
I. 

Five children were given 2 minutes of 
operant level, followed by 8 minutes of 
conditioning and 5 minutes of extinction. 
Two other children were given 2 minutes 
of operant level followed by 18 minutes 
of conditioning. Operant levels were kept 
short to prevent the children from ex- 
tinguishing completely before reinforce- 
ments could be delivered. 

Reinforcement of all speech was de- 
livered on a variable ratio schedule. The 
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basic speech unit was defined as 1 second 
of speech. A stopwatch was started when 
the child began talking and interrupted 
whenever the child stopped talking. 
When the cumulated amount of time 
spoken reached the value prescribed by 
the schedule, a reinforcement was deliv- 
ered. Initially, all children worked on a 
4:1 schedule, a mean of 4 seconds of 
speech being required for each reinforce- 
ment, with a range of 2 to 8 seconds of 
speech. They were then switched to an 
8:1 schedule with a range of 4 to 12 sec- 
onds of speech. 

Two of the children in this group re- 
quired extensive prodding; the rest spoke 
continuously on their own. For this ex- 
periment the first prod was administered 
after a pause of 1 minute, successive prods 
being administered after 15-second pauses. 
All children were given a small gift after 
the experimental session. 


Experiment III 


The sample consisted of 23 children 
taken from the Ist grade of a New York 
City Public School. The children ranged 
in age from 6 to 7 years. 

This experiment was carried out in a 
different laboratory than the above two 
experiments, by two different Es. 

Each child was seated at a small table 
and a specially devised colored story book 
was read to him which also dealt with a 
clown who liked to have children talk to 
him. E did not speak to the children 
except for reading the story. 

The child was then seated at another 
table in front of a papier-maché clown 
similar to the one used in the two former 
studies. A large screen behind the clown 


4 Acknowledgment is made of the co- 
operation of the staff of Public School 16. 


cut off the child’s view of both Es and the 
tape recorder. 

The child received the same tape re- 
corded instructions as in the prior experi- 
ments. 

Each session lasted 15 minutes, and 
consisted of 5 minutes of conditioning, 
5 minutes of extinction, and 5 minutes of 
reconditioning. Reinforcement of all 
speech was delivered on a 10-second fixed 
interval schedule. This schedule is a rela- 
tively easy one to follow using a stopwatch 
where 10-second units are clearly and regu- 
larly marked. 

Prods were administered only after 
pauses of 1 minute and these never, except 
as a last resort, elicited speech directly 
from the child. Instead, they were of the 
following type: “try to make the clown 
happy”; “the clown is sad”; “try to get 
Happy’s nose to light up.” 

All children were given a small gift 
after the experimental session. 


Experiment IV 


The sample consisted of the same 23 
children as in experiment III with the 
addition of two children whose data were 
not reported for that experiment because 
they had received a somewhat different 
procedure than the rest of the group. 

In the present experiment, these 25 
children were given the procedure already 
described for experiment III, except that 
a different response class was reinforced. 
In this case a specific response class was 
chosen consisting of statements which in- 
cluded the pronouns, “I,” “we,” mer’ 
and “us.” It was selected in order to yield 
information on the specificity or generality 
of the application of reinforcement to a 
specific response class imbedded within 
the more general class of continuous 
speech. Reinforcement was given on a 
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regular 1:1 schedule, an attempt being 
made to reinforce as soon as possible after 
the occurrence of each of the first person 
pronouns. 


Experiment V 


A small group of four children taken 
from the Ist grade in the public school 
was used. 

The procedure was the same as that 
utilized in the two prior experiments ex- 
cept that no reinforcements were adminis- 
tered and all references to the clown’s 
nose lighting up were omitted from the 
story and from the taped instructions. 
The children were thus told only that the 
clown would be made happy if they spoke 
to him. 

The session lasted 15 minutes. Prods 
were administered only after pauses of 1 
minute in length. 

The children were given a gift at the 
end of the session. 


Results 


Data from all the experiments are sum- 
marized in Table 1. Due to differences in 
the length of time the children’s behavior 
was sampled during each of the experi- 
ments, the basic data have been converted 
to word rate rather than absolute number 
of words. 


EXPERIMENT I 


A comparison of speech rate among'the 
three experimental periods consisting of 
conditioning, extinction, and recondition- 
ing was made, using the Friedman non- 
parametric analysis of variance (12). The 
difference among the three conditions was 
statistically significant (p < .05). The 
distribution of the sums of ranks for the 
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three conditions was 16, 14, and 24. This 
indicates that a very small change oc- 
curred from conditioning to extinction 
and that the larger change occurred from 
extinction to reconditioning. Since the 
extinction periods for Ss in this group 
were generally only 1 or 2 minutes long, 
it might be supposed that extinction never 
actually had a chance to take place. The 
effectiveness of the reinforcement seems 
more evident in the final reconditioning 
period where seven of the nine children 
showed an increase in speech rate. 


EXPERIMENT II 


A comparison of operant level, condi- 
tioning, and extinction was made for the 
five children given the same procedure, 
using the Friedman nonparametric analy- 
sis of variance. The total sums of ranks 
for these three periods were, respectively, 
5, 12, and 13, and were statistically sig- 
nificant (p = .03). 

This indicates that the largest change 
occurred from operant level to condition- 
ing and that resistance to extinction was 
strong. The strength of the response 
might be accounted for by the fact that 
reinforcement was administered on a 
variable ratio schedule which customarily 
produces this effect. 

The other two children in the group 
who were given an operant level of 2 
minutes followed by 18 minutes of condi- 
tioning also showed an increase from 
operant level to conditioning. 

A comparison of speech rate during the 
first periods was made between the nine 
children of experiment I and the seven 
children of experiment II in order to test 
the effect of initially administering rein- 
forcement. The experiment I children re- 
ceived reinforcement and the experiment 
II children received no reinforcement 
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OPERANT CONDITIONING OF CONTINUOUS SPEECH 


during the initial period. Speech rate was 
consistently higher for the experiment I 
children than for the experiment II chil- 
dren, the mean sums of ranks respectively 
being 10.7 and 5.7. The difference, tested 
by the Mann-Whitney unpaired replicates 
test (12), was statistically significant 
(p = 025, one-tailed test). When the 2- 
minute operant level of experiment II 
was compared with only the first 2 min- 
utes of conditioning in experiment I, the 
same difference was found (p = .015). 


ExPERIMENT III 
\ comparison of speech rate during 


conditioning, extinction, and recondition- 
ing was made using the Friedman non- 


2.5, and 51.5, respectively, the distribu- 
tion being statistically significant (.001 < 
p <.01). Four of the 23 children were 
then separated from the group as “non- 
talkers,” since all their speech had been 
elicited by prods. This group, when tested 
by the same statistical procedure, showed 
a distribution of sums of ranks of 10.5, 
8.5, and 5, which was not statistically sig- 
nificant (.12 < p < .27). None of these 
subjects displayed a pattern that might be 
expected from the reinforcement contin- 
gencies. The remainder of the group con- 
sisted of 19 children all of whom spoke 
without prods. The distribution of sums 
of ranks for conditioning, extinction, and 
reconditioning was 43.5, 24, and 46.5, 
which was statistically significant (p < 
.001). Examination of the sums of ranks 
indicates that the withdrawal of rein- 
forcement during extinction produced a 
consistently lower speech rate. Resistance 
to extinction was not as great for this 
group which was given fewer reinforce- 
ments on a fixed interval schedule as for 
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the prior experimental group which had 
been given more reinforcements on a 
variable ratio schedule. 

The children of the three experimental 
groups were compared on their rate of 
speech during the initial period. The first 
group was a conditioning group, given 
reinforcement on a 2-second fixed interval 
schedule for 2 minutes and an intermit- 
tent schedule the rest of the period. The 
second group was an operant level group 
where no reinforcement was administered, 
and the third group was a conditioning 
group with reinforcement given on a 10- 
second fixed interval schedule. The mean 
sums of ranks were 25.7 for the first group, 
15.4 for the second group, and 15.3 for 
the third group. This distribution was 
tested for statistical significance by the 
Kruskal-Wallis one-way analysis of vari- 
ance (12) and found to be significant 
(.02 < p < .05). Examination of the sums 
of ranks shows that the first group, which 
was given the most reinforcement, had 
the highest speech rate. The sums of 
ranks of the other two groups are the 
same. 


ExpertMent IV 


A comparison of speech rate among the 
three periods of conditioning, extinction, 
and reconditioning was made and found 
statistically significant (.02 < p < .05) 
using Friedman’s analysis of variance. The 
distribution of sums of ranks was 50.5, 
40.5, and 59. The 25 children in the group 
had been reinforced for statements includ- 
ing the pronouns I, we, me, and us. The 
same comparison was made for the five 
nontalkers in the group and was found 
not to be statistically significant (p = .69). 
The distribution of sums of ranks was 
9.5, 8.5, and 12. Also statistically nonsig- 
nificant (p = .62) was a comparison of 
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the three conditions based on the data 
from seven children, other than non- 
talkers, each of whom received less than 
10 reinforcements in conditioning and in 
reconditioning. The distribution of the 
sums of ranks was 16, 12, and 14. The 
remainder of the group consisted of 13 
children who spoke without prodding and 
who received 10 or more reinforcements 
during either conditioning or recondition- 
ing. A statistically significant difference 
(.02 < p < .05) was found between con- 
ditioning, extinction, and reconditioning; 
the sums of ranks for these periods were, 
respectively, 25, 20, and 33. This result 
indicates that, although the reinforcement 
was applied to a specific response class, its 
actual effect was to increase a more gen- 
eral response class, namely, total speech 
rate, as though the reinforcement had 
been applied intermittently to that class. 

An examination of the changes brought 
about by reinforcement in the response 
class of I-, we, me-, and us-statements 
showed the same results as total speech 
rate. The entire group of 25 children 
showed a distribution of sums of ranks of 
53, 36.5, and 60.5 (.001 < p < .01). The 
five nontalkers showed a distribution of 
10, 9.5, and 10.5 (.95 <p < 1.00). The 
seven children who received less than 10 
reinforcements showed a distribution of 
16, 11.5, and 14.5 (p = .6). The remain- 
ing 13 children showed a distribution of 
27, 15.5, and 35.5 (p < .001). 

In order to check further on the ap- 
parent correlation between the specific 
class of personal pronouns which was regu- 
larly reinforced and the general class of 
total speech rate, a comparison was made 
of the total group of 25 children for the 
difference between conditioning, extinc- 
tion, and reconditioning, based on the 
proportion of I-, we-, me-, and us-state- 


ments to total number of words. If the 
two response classes were highly corre- 
lated, then there should be no difference 
between these proportions for the three 
experimental conditions. This turned out 
to be the case, the distribution of the 
sums of ranks for the three conditions 
being 54, 43.5, and 52.5 (.2<p<.3). 
Also, none of the three subgroups of chil- 
dren showed a significant difference be- 
tween these proportions for the three 
conditions. For the five nontalkers, the 
sums of ranks for conditioning, extinction, 
and reconditioning were 11.5, 10, and 8.5 
(.69 < p < .95); for the seven children re- 
ceiving less than 10 reinforcements, they 
were 15.5, 12.5, and 14 (p = .6); for the 
remaining 13 children, they were 27, 21, 
and 30 (.2 < p < .3). Thus we see that 
in each subgroup, as well as in the total 
group, the specific response class (I, we, 
me, us) and the general one (amount of 
speech) were highly correlated and the 
evidence suggests that the reinforcement 
may have acted on the more general class 
as well as on the specific class. 


EXPERIMENT V 


Since no reinforcement was delivered 
during the experiment, an analysis of 
changes in total speech rate over time was 
done by dividing the session into three 
successive 5-minute periods. The distribu- 
tion of sums of ranks over these three 
periods was 10, 8, and 6 (p = .43). Three 
of the children showed an extinction ef- 
fect, speech rate decreasing steadily with 
time. The fourth child showed an increase 
in speech with time even though she 
started the session with a fairly high rate. 
No child showed the dip in speech rate 
during the middle 5 minutes which was 
characteristic of the children who were 
given extinction periods at that time. 
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DISCUSSION 


The use of behavior theory for examin- 
ing children’s speech has yielded some 
interesting information, Treating speech 
as behavior in and of itself, and not as 
a symbolic representation of underlying 
meaning, has demonstrated lawful rela- 
tionships which fit the general theoretical 
framework of behavior theory. 

Examination of the effect of reinforce- 
ment on speech rate, when speech is con- 
sidered a free operant, reveals the follow- 
ing: In all of the first four experimental 
situations where reinforcement was ad- 
ministered, an increase in rate occurred. A 
corresponding decrease in rate or stabiliza- 
tion at the previous conditioning rate oc- 
curred when it was withheld. This result 
was more pronounced when “nontalkers,” 
i.e., subjects who did not speak without 
specific questioning or prodding by E, 
were removed from the group. Indeed, the 
speech of this nontalker subgroup could 
not be called a free operant. 

It was also found that reinforcement 
produced a conditioning effect only if a 
minimum number of reinforcements was 
administered. This finding of a lower limit 
on the required number of reinforcements 
was also shown in a series of studies by 
Salzinger and Pisoni (8, 9, 10). For the 
present experiments reinforcement was 
not effective unless a subject was given at 
least 10 reinforcements. Subjects who re- 
ceive less than the required number of 
reinforcements are probably equivalent to 
those who receive no reinforcements. For 
the latter no conditioning effect could be 
found, and in three out of the four chil- 
dren in experiment V, an extinction effect 
was found to occur with time. 

Although changes in speech rate corre- 
sponded with those which were expected 


on the basis of the reinforcement proce- 
dures used, the effectiveness of reinforce- 
ment should be further tested during 
longer experimental sessions, For the pres- 
ent study, it was decided to run the chil- 
dren for a short time only to see if we 
could pick up the effect with a procedure 
which would not tax the children’s atten- 
tion span. At this time, further procedures 
are being devised so as to lengthen the 
sessions using older children. 

The 5-minute extinction sessions for 
speech rate in experiments II, III, and IV 
produced different rates of response de- 
pending upon the procedures used. A few 
variables would be relevant for considering 
these differences in response strength. Be- 
havior theory predicts greater resistance to 
extinction for variable than for regular 
scheduling, for ratio than for interval 
scheduling, and, finally, more extinction 
responses the greater the number of rein- 
forcements administered (2). The group 
which showed the lowest response rate 
during extinction as well as the greatest 
decrease in rate from conditioning to ex- 
tinction was that group which received the 
fewest reinforcements and which was also 
on a fixed interval schedule. The highest 
response rate occurred during extinction 
of the group which had been given vari- 
able ratio scheduling. The two groups 
where word rate was reinforced on a vari- 
able schedule showed no decrease from 
conditioning to extinction. These results 
indicate that all the above variables are 
operating on the extinction behavior and 
that further study, specifically designed 
to test separately for the differences in 
scheduling and number of reinforcements, 
is needed to evaluate the contribution of 
each factor. . . . 

One further difference appears with re- 
gard to the speech rate of the children 
from the private nursery school and those 
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from the public school. In general, it ap- 
pears that the children from the private 
nursery school, most of whom come from 
professional middle class homes, were 
more verbally fluent than the public 
school children, who were primarily a 
lower socioeconomic group. The operant 
level for speech rate for the private schocl 
group in experiment II was just as high as 
the conditioning rate of the public school 
group. The conditioning speech rate for 
the private school group in experiment I 
was considerably higher than the condi- 
tioning speech rate of the public school 
group. The difference between the two 
groups of children can be further ex- 
plained by a difference in the types and 
frequency of prods employed. More fre- 
quent and more direct prods might have 
increased the speech rate of the reluctant 
talkers in the private nursery school 


group. 


SUMMARY 


The spontaneous continuous speech of 
children ranging in age from 5 to 7 years 
was reinforced under various experimental 
conditions. The reinforcing apparatus 
consisted of a papier-maché clown’s head, 
the nose of which was a red light bulb. 

The children were instructed to talk to 
the clown to make him happy and thereby 
get his nose to light up. The occurrence 
of the reinforcing light was made contin- 
gent upon different aspects of the chil- 
dren’s speech in each experiment. 

It was found that speech rate increased 
as a result of the administration of rein- 
forcement and decreased or stabilized 
when reinforcement was withheld. Both 
the number of reinforcements delivered 
and the schedule appeared to produce 
differences in response strength. Rein- 


forcements were not effective unless more 
than 10 were administered. The applica- 
tion of reinforcement to the response 
class of first person pronouns produced an 
increase not only in the specific class itself 
but also in general speech rate. A control 
group of children who were given no rein- 
forcement showed no systematic changes 
in speech rate other than an extinction 
effect with time. 
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Teaching Machines: An Application 
of Principles from the Laboratory*’ 


James G. Holland 


Much has been said of teaching ma- 
chines recently—but the emphasis has 
tended to be on the gadgets rather than 
on the much more significant develop- 
ment of a new technology of education 
initiated by B. F. Skinner (1954, 1958). 
The technology does use a device called 
a teaching machine, which presents a 
finely graded series of problems and pro- 
vides immediate “reward” or reinforce- 
ment for the student’s correct answers. 
But emphasis on machines has tended to 
obscure the more important facets of the 
new technology based on application of 
principles from the laboratory. The ma- 
chines of today are not necessarily better 
than those of yesterday. Indeed, adequate 


* From J. G. Holland, Teaching machines: 
an application of principles from the labo- 
ratory, J. exp. anal. Behav., 3, 275-287 
(1960). Reprinted by permission of the 
author and the Journal of the Experimental 
Analysis of Behavior. 


machines could have been built hundreds 
of years ago. The movement today is not 
simply the mechanization of teaching, 
but instead the development of a new 
technology—a behavioral engineering of 
teaching procedures. 

The history of unsuccessful teaching 
machines illustrates the relatively greater 
importance of the technique as opposed 
to the gadgets. The first teaching ma- 
chine was patented 93 years ago. ‘There 
have since been a series of patents and a 
promising burst of activity initiated by 
Sidney Pressey (1926) in the 1920's. 
None of these early efforts really caught 
hold. But during this period in which the 
idea of mechanized teaching has been 
latent, the science of behavior has de- 


1 This article was invited by the edi- 
torial board. It was previously presented 
before the 1959 Invitation Conference on 
Testing Problems sponsored by the Edu- 
cational Testing Service, and will appear 
in the Proceeding of the Invitational Con- 
ference on Testing Problems in 1960. The 
work discussed in this paper has been sup- 
ported by grants from the Carnegie Corpo- 
ration and the Ford Foundation. 
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veloped principles which permit extremely 
precise control of behavior. This new 
technology is not only the so-called auto- 
mation of teaching, but is an attempt to 
obtain the kind of behavioral control 
shown possible in the laboratory. 

We have, of course, seen other practi- 
cal applications of scientific psychology. 
We are all familiar with the development 
of a technology of testing, which permits 
placing an individual in situations suited 
to his abilities. We are also familiar with 
another technology called human engi- 
neering, which fits machines and jobs to 
the capacities of man. One places a man 
in a job that suits him; the other alters 
the job to suit the man; neither attempts 
to alter or control man’s behavior. 

For years in the laboratory we have 
controlled the behavior of experimental 
subjects—both animal and human—by a 
widening array of principles and tech- 
niques. The new technology of education 
is the application of behavioral laws in 
modifying or controlling behavior. Such 
a technology became possible with the 
realization that we are actually referring 
to a verbal repertoire (Skinner, 1957) 
controlled by the same laws as other be- 
havior. The old, defunct explanatory con- 
cepts of knowledge, meaning, mind, or 
symbolic processes have never offered the 
possibility of manipulation or control; 
but behavior, verbal or otherwise, can be 
controlled with ease and precision. 

While machines are not the essential 
or defining aspect of this technology, they 
do play an important role in providing 
some of this fine control the technology 
requires. We will now examine several 
machines and notice the advantages they 
offer. 

At Harvard there is a self-instruction 
room with ten booths, each containing a 
machine such as the one shown in Fig. 1. 


The students gets one set of material 
from the attendant and places it in the 
machine. He closes the machine and be- 
gins his studies. 

This machine presents one item of ma- 
terial at a time. The subject reads the 
statement, which has one or more words 
missing, and he completes it by writing in 
the answer’space. He then raises the lever 
and a small shutter opens, revealing the 
correct answer. Simultaneously, his an- 
swer is moved under glass, where it can be 
read and compared with the now-exposed 
correct answer. After comparing his an- 
swer with the correct answer, the student 
indicates to the machine, with an ap- 
propriate movement of the lever, whether 
his answer was correct or incorrect, and 
the next item appears in the window. He 
repeats all items answered wrong after he 
completes the set of items. He does not 
repeat correctly answered items. 

A critical feature of the machine is that 
it provides immediate reinforcement for 
correct answers. Being correct is known 
to be a reinforcer for humans. In machine 
teaching, reinforcement is immediate. 
We know from laboratory work (Perin, 
1943) that a delay between a response 
and its reinforcement of a few seconds 
will greatly reduce the effectiveness of the 
reinforcement. Adult human subjects can 
sustain at least small delays; nevertheless, 
any delay makes reinforcement less effec- 
tive. 

Although other techniques such as pro- 
grammed workbooks (Homme & Glaser, 
1959) and flashcards are sometimes used 
in this new behavioral technology, they 
offer less control. Teaching machines 
eliminate undesirable forms of responses 
which would also be successful in obtain- 
ing the right answer. For example, the 
teaching machine insures that the student 
answers before peeking at the indicated 
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answer. There is a strong temptation to 
glance ahead with only a poorly formu- 
lated, unwritten answer when pro- 
grammed workbooks or flashcards are 
used. 

This write-in machine is a prototype of 
the most common machine. There is an- 
other machine used for teaching young 
children material which consistently has 
a single possible answer. In the machine 


FIG. 1. Student working at a write-in 
teaching machine. From Holland: Teach- 
ing machines: an application of principles 
from the laboratory. 


the constructed answer is automatically 
compared with the true answer. The 
child is presented a problem, perhaps a 
statement such as 2+2=-_, and he 
must provide the 4. By moving a slider 
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appropriately, he can insert the 4 into the 
answer space. He then turns the crank, 
and the next item appears immediately, 
so that immediate reinforcement is pro- 
vided. 

Both of the machines we have seen 
thus far require the student to compose 
the answer. Figure 2 shows a machine for 
a less mature organism who cannot yet 
compose an answer. This machine can be 
used for teaching preschool children.? 
There is a large top window and three 
small windows. In the large window, 
there is some sort of problem; and in the 


2 Hively, W. An exploratory investiga- 
tion of an apparatus for studying and 
teaching visual discrimination using pre- 
school children. (In preparation.) 


three smaller windows, there are three 
alternative choices. For example, in the 
machine as seen in the picture, the sub- 
ject chooses one of the three alternatives 
which has the same form as the sample, 
independent, in this case, of color or size. 
When the correct choice is made, the 
next frame is presented. 

A teaching machine for a still lower or- 


FIG. 2. Child working on the preverbal 
machine, In the upper rectangular window 
is a sample which is to be matched with 
a figure in one of the three lower win- 
dows. If the child presses the correct 
lower window, the material advances to 
the next frame. In this case, the match is 
in terms of form, with size and color ir- 
relevant. From Holland: Teaching ma- 
chines: an application of principles from 
the laboratory. 
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ganism is shown in Fig. 3. This pigeon, 
with the aid of a teaching machine, has 
learned to hit the name plaque appropri- 
ate for a color projected above him. ‘The 
principal difference between this and the 
other machines is that food reinforce- 
ment is used. With humans, simply being 
correct is sufficient reinforcement—pi- 
geons will not work for such meager 
gains. 

Enough of machines. They should not 
be allowed to obscure the truly important 
feature of the new technology, namely, 
the application of methods for behavioral 
control in developing programs for teach- 
ing. We need to say no more about the 
well-known principle of immediate rein- 
forcement. Our second principle is also 
well known. Behavior is learned only 


FIG. 3. A pigeon “naming colors.” The 
pigeon pecks the color name correspond- 
ing to the color of the light projected 
above him. From Holland: Teaching ma- 
chines: an application of principles from 
the laboratory. 


when it is emitted and reinforced. But in 
the classroom, the student performs very 
little, verbally. However, while working 
with a machine, the student necessarily 
emits appropriate behavior, and this be- 
havior is usually reinforced because the 
material is so designed that the student is 
usually correct. Not only is reinforcement 
needed for learning, but a high density of 
correct items is necessary because ma- 
terial which generates errors is punishing. 
Laboratory experiments (Azrin, 1956) 
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have shown that punishment lowers the 
rate of the punished behavior. In our ex- 
perience with teaching machines, we have 
also observed that students stop work 
when the material is so difficult that they 
make many errors. Furthermore, they be- 
come irritated, almost aggressive, when 
errors are made. 

The third important principle is that of 
gradual progression to establish complex 
repertoires. A visitor once asked if Skinner 
had realized that pigeons were so smart 
before he began using them as subjects. 
The answer given by a helpful graduate 
student was that they weren’t so smart 
before Skinner began using them. And 
indeed they weren’t. The behavior de- 
veloped in many experiments is like that 
developed in the classroom. Both are 
complex operants. Both require a careful 
program of gradual progression. We can- 
not wait for a student to describe the 
content of a psychology course before 
reinforcing the performance; nor can we 
wait for a pigeon to emit such an im- 
probable bit of behavior as turning a cir- 
cle, facing a disk on the wall, pecking it if 
lit, and then bending down to a now- 
exposed food tray and eating. When de- 
veloping a complex performance in a 
pigeon, we may first reinforce simply the 
behavior of approaching the food tray 
when it is presented with a loud click. 
Later, the pigeon learns to peck a key 
which produces the click and the food 
tray. Still later, he may learn to peck this 
key only when it is lit, the peck being fol- 
lowed by the loud click and approach to 
the food tray. In the next step, he may 
learn to raise his head or hop from one 
foot to another, or walk a figure eight, in 
order to produce the lighted key which 
he then pecks; the click follows, and he 
approaches the food tray. This principle 
of gradual progression runs through many 


of the teaching-machine techniques. Both 
human and avian scholars deserve the 
same careful tutorage. The teaching-ma- 
chine program moves in very finely graded 
steps, working from simple to an ever- 
higher level of complexity. Such a gradual 
development is illustrated in Table 1 by a 
few items taken from a psychology pro- 
gram.’ 

The principle of gradual progression 
serves not simply to make the student 
correct as often as possible, but it is also 
the fastest way to develop a complex 
repertoire. In fact, a new complex operant 
may never appear except through sepa- 
rately reinforcing members of a graded 
series (Keller & Schoenfeld, 1950). Only 
this way can we quickly create a new pat- 
tern of behavior. The pigeon would not 
have learned the complex sequence neces- 
sary to receive the food if it had not 
learned each step in its proper order. Ob- 
viously, a child can’t begin with advanced 
mathematics, but neither can he begin 
with 2 +2 = 4—even this is too complex 
and requires a gradual progression. 

Our fourth principle is, in a sense, an- 
other form of gradual progression—one 
which involves the gradual withdrawal of 
stimulus support. This we shall call fad- 
ing. This method will be illustrated with 
some neuroanatomy material.* Figure 4A 
is a fully labelled cross section of the 
medulla oblongata. This is placed before 
the student while he works with a large 
set of items pertaining to the spatial 


3 This program, prepared by J. G. Hol- 
land and B. F. Skinner, is entitled A self- 
tutoring introduction to a science of be- 
havior. 

4This material has been prepared by 
D. M. Brethower in collaboration with the 
present author, and it is being used at 
Harvard for research purposes. 
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Items from the Psychology Program (11). These Items Illustrate the 
Gradual Development of a New Concept 
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ITEM 


CORRECT ANSWER 
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PERCENTAGE OF 
STUDENTS GIVING 
THE ANSWER 


1, Performing animals are sometimes trained 
with “rewards.” The behavior of a hungry 
animal can be “rewarded” with —__—_. 


2. A technical term for “reward” is reinforce- 
ment. To “reward” an organism with food 
is to it with food. 


3. Technically speaking, a thirsty organism 
can be with water. 


50. A school teacher is likely, whenever pos- 
sible, to dismiss a class when her students 
are rowdy because she has been 
by elimination of the stimuli arising from 
a rowdy class. 


51. The teacher who dismisses a class when it 
is rowdy causes the frequency of future 
rowdy behavior to (1) since 
dismissal from class is probably a(n) 
(2) —— for rowdy children. 


54, If an airplane spotter never sees the kind 
of plane he is to spot, his frequency of 
scanning the sky (1) . In 
other words his “looking” behavior is 


(2) 


Food 


Reinforce 


Reinforced 


Reinforced 


(1) Increase 
(2) Reinforcement 


(1) Decreases 

(2) Extinguished 

(or: Not Rein- 
forced) 


96 


100 


100 


92 


86 


94 


From Holland: Teaching machines: an application of principles from the laboratory. 


arrangement of the various structures. For 
example, “posterior to the cuneate nuclei 
are the .” The answer is: “the 
cuneate fasciculi.” After many such items, 
he begins another set and has another 
picture (Fig. 4B); but now the structures 
before him are labelled only with initials. 
A new set of items again asks a long series 
of questions pertaining to the spatial posi- 


tion of the various structures. For exam- 
ple, “between the gracile and the trigemi- 
nal nuclei are .” The answer is 
the “cuneate nuclei.” After many more 
items, he proceeds to a new set and the 
next picture. This time (Fig. 4C), the 
picture is unlabelled. Again, he goes 
through a series of new items, not simple 
repetitions of the previous ones, but items 


108 Verbal Behavior 


pertaining to the same problem of the 
spatial location of the different structures. 
This set is followed by still another but 
with no picture at all. He is now able to 
discuss the spatial position of the struc- 
tures without any visual representations 
of the structures before him. In a sense, 
he has his own private map of the me- 
dulla. He may further demonstrate his 
newly acquired ability by accurately draw- 
ing the medulla. The neuroanatomy ex- 
ample is an elaborate example of fading. 
Fading is also applied in a more simple 
form in constructing verbal programs 
without pictorial displays. A single item 
may in one sentence give a definition or 
a general law and in a second sentence in 
that same item, an example in which a 
key word is omitted. This would be fol- 
lowed by a new example in the next 
frame, but with the definition or law 
lacking. 

This brings us to our fifth principle: 
control of the student’s observing and 
echoic behavior. In the classroom the 
student is often treated as though he were 
some kind of passive receiver of informa- 
tion, who can sop up information spoken 
by the teacher, written on the blackboard, 
or presented by films. But all of these are 
effective only insofar as the student has 
some behavior with respect to the ma- 
terial. He must listen carefully, or read 
carefully, thus engaging in usually covert 
echoic behavior. Ineffectiveness of class- 
room techniques is often credited to “in- 
attention” or poor “concentration.” It has 
been shown (Reid, 1953; Wyckoff, 1952) 
that if a discrimination is to be learned, 
adequate observing behavior must first be 
established. We have further found that 
observing behavior, or speaking loosely, 
“attention,” is subject to the same forms 
of control as other behavior (Holland, 


1958). This control of observing behavior 
is of prime importance. When the stu- 
dent becomes very “inattentive” in the 
classroom, the teaching material flows on; 
but with a machine, he moves ahead only 
as he finishes an item. Lapses in active 
participation result in nothing more than 
the machine sitting idle until the student 
continues. There is, however, a more 
subtle aspect to the control of observing 
behavior than this obvious mechanical 
one. In many of the examples we have 
seen, success in answering the problem 
depends only on the student’s careful ob- 
servation of the material in front of him 
at the moment. This may be illustrated 
by more material from the psychology 
program. A graph showing stimulus-gen- 
eralization data is in front of the student 
while he works on the machine. In the 
program he may complete a statement: 
“As the wave length changes in either 
direction from the wave length present 
during reinforcement, the number of re- 
sponses .” The answer is “de- 
creases.” The item serves only to control 
the behavior of observing the data. Of 
course, many more such items are used to 
discuss the same data. 

This principle of controlled observa- 
tion extends to the details of writing a 
single item. For example, “Two events 
may have a common effect. An operant 
reinforced with two reinforcers appropri- 
ate to different deprivations will vary 
with deprivations.” The an- 
swer is “two” or “both.” Here, the pro- 
grammer’s choice of the omission serves 
to insure a careful reading of the item. 
Only those parts of an item which must 
be read to correctly complete a blank can 
safely be assumed to be learned. 

Our sixth principle deals with discrimi- 
nation training. In learning spoken lan- 
guages, for example, it is necessary to be 
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FIG. 4. An illustration of the technique of fading. Section A is in front of the student 
while he is working on the earliest items of a neuroanatomy program; Section B is in 
front of the student for later items; and Section C, for still later items. From Holland: 
Teaching machines: an application of principles from the laboratory. 
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able to identify the speech sounds. A stu- 
dent may listen to a pair of words on a 
special phonograph which repeats the 
passage as many times as he desires. The 
visual write-in machine instructs him to 
listen to a specific passage. For example, 
the student may hear two words such as: 
“sit, set.” He listens as many times as he 
needs and then writes the phonetic sym- 
bols in the write-in machine. He then 
operates the machine, thereby exposing 
the true answer and providing immedi- 
ate reinforcement for his correct discrimi- 
nation. 

However, little academic education is 
simple discrimination. More often, it is 
abstraction or concept formation. An ab- 
straction is a response to a single isolated 
property of a stimulus. Such a property 
cannot exist alone. Redness is an abstrac- 
tion. Anything that is red has other prop- 
erties as well—size, shape, position in 
space, to name a few. There are red balls, 
red cars, red walls. The term red applies 


to all of them, but not to green balls, 
blue cars, or yellow walls. To establish an 
abstraction (Hovland, 1952, 1953), we 
must provide many examples. Each must 
have the common property, but among 
the various examples there must be a 
wide range of other properties. This is 
best illustrated by examples from the pre- 
verbal machine shown in Fig. 5. 

These are from a program’ which 


5 This program was prepared by B. F, 
Skinner. 


FIG. 5. Selected items from a program 
which teaches young children to respond 
in terms of the abstract property of form. 
The upper rectangle in each of the frames 
is the sample. The child must pick the 
alternative which corresponds to the sam- 
ple in form. The color of each letter, as it 
appeared in the program, is indicated by 
the various shaded areas. From Holland: 
Teaching machines: an application of 
principles from the laboratory. 


teaches a child to respond to the abstract 
property of form. In each item, the upper 
figure is the sample and the lower three 
are the alternatives. While developing a 
program for establishing an abstraction, 
we remember our earlier principles and 
move through a gradual progression. The 
first several items would be like the first 
one; here, there is a sample and a single 
match, the other two being blank. The 
sample and its match are exactly alike at 
this stage. After many such items, we 
would begin to have others like the next 
one, in which the sample and its match 
again correspond in size, color, and form 
—but an additional incorrect alternative 
has been added which differs from the 
sample in all these aspects. Later, we 
move on to frames with three choices; 
again, the sample and its match corre- 
spond exactly. Next, the sample and the 
match may differ in some property such 
as color, in the case of the next item 
shown, or size in the next. It is essential 
that the program contain many items 
among which the sample and correct 
match differ in all properties except the 
one providing the basis for the abstrac- 
tion. Otherwise, the abstraction will be 
incomplete because the extraneous prop- 
erty will share some of the control over 
the abstract response. As we move on 
with additional examples, the sample and 
the correct match differ both in color and 
in size, and the incorrect alternatives are 
beginning to share some of the extrane- 
ous properties with the sample. The stu- 
dent continues with many such problems 
in which the only common property be- 
tween the sample and the correct match 
is the shape, regardless of size and color. 
Even now our abstraction may be incom- 
plete. We have kept the figures in only 
one orientation. Therefore, we also have 
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a series in which the samples are rotated 
as in the next item. A great deal of aca- 
demic education consists of trying to 
teach abstractions. Concepts such as 
force, reinforcement, supply and demand, 
freedom, and many, many other possible 
examples are all abstractions. Further- 
more, in the academic setting, the student 
seldom adequately forms abstractions. 
The trigonometry student commonly uses 
triangles with the right angle as one of 
the two lower angles. If the triangle is 
rotated 90°, so that the right angle is 
upward, the student often does not recog- 
nize it as a right triangle. Neither is an 
abstraction developed simply by learning 
a definition. The psychology student who 
learns the definition of reinforcement in 
formal terms and is acquainted with a 
laboratory example of food reinforcement 
may not realize the horrible consequences 
of sending his girl friend flowers to end 
an argument. Thus, in the psychology 
program, we follow the pattern in the 
preverbal example to develop a new con- 
cept: Wide ranges of examples are ana- 
lyzed which differ in as many aspects as 
possible, each still having the common 
property which characterizes the concept. 

The last principle I shall discuss is 
really a question of a methodology which 
has served so well in the laboratory. This 
principle is to let the student write the 
program. A few years ago, the cartoon 
shown in Fig. 6 was published in the 
Columbia Jester. 

The rat leaning on the bar is saying to 
the other rat: “Boy, do we have this guy 
conditioned. Every time I press the bar 
down, he drops a pellet in.” Although 
said in jest, it is true that the rat controls 
the experimenter’s behavior. When inter- 
esting things are observed about the rat’s 
behavior, the control circuits are rewired 
to investigate the interesting new facet of 
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FIG. 6. “Boy, do we have this guy con- 
ditioned. Every time I press the bar down 
he drops a pellet in.” From Holland: 
Teaching machines: an application of 
principles from the laboratory. 


behavior. In a sense, the rat is wiring the 
control circuit. Similarly, the behavioral 
engineer who prepares good teaching- 
machine material must be under the con- 
trol of the student’s responses. When the 
student has trouble with part of a pro- 
gram, the programmer must correct this. 
The student’s answers reveal ambiguities 
in items; they reveal gaps in the program 
and erroneous assumptions as to the stu- 
dent’s background. The answers will show 
when the program is progressing too 
rapidly, when additional prompts are 
necessary, or when the programmer 
should try new techniques. When un- 
expected errors are made, they indicate 
deficiencies not in the student but in the 
program. 

The most extensive experience with 
this principle of modifying the program 
to fit the student has been at Harvard 
with the psychology program. In 1958, 
we had a program consisting of 48 disks 
or lessons of 29 frames each. After using 
the program and making a detailed, item- 
by-item analysis of the students’ answers, 
we diagnosed the particular deficiencies 


in the program and revised it accordingly. 
The program was also extended to cover 
a larger amount of subject matter; and in 
1959, it consisted of 60 disks. You have 
already seen a few items from the course. 
After using the revised material in 1959, 
we evaluated the extent of its improve- 
ment. The next [table] shows the percent- 
age of errors on the first 20 disks for each 
of the 2 years. 


TABLE 2 
A Comparison of the Students’ Errors in Using 
the Revised (1959) and Unrevised (1958) 
Program in Psychology 
———————————————— 


PERCENT ITEMS 


PERCENT IMPROPERLY SCORED 
ERRORS BY STUDENTS 
1958 20.1 3.6 
1959 11.0 14 


SOAN ASTA S a a eam 
From Holland: Teaching machines: an applica- 
tion of principles from the laboratory. 


The revision eliminated about half the 
errors. The last column of the table gives 
percentage of improper self-scoring by the 
students. Revision also cut these scoring 
errors approximately in half. Furthermore, 
the revision decreased the time required 
to complete the material. Although the 
second year’s material had more disks— 
60 as opposed to 48—it actually required 
the average student about 1 hour less to 
complete the work than the shorter, first 
version had done. Frequency distributions 
on the median times in minutes for com- 
pletion of the various disks are shown in 
Fig. 7. These are the times required for 
the median student to move through 
each set of material answering every item 
once and to repeat items answered in- 
correctly. Notice the considerable time 


required for many disks in the first year’s 
material, Primarily, this was because stu- 
dents repeated the larger number of items 
missed in the first cycle. 

But the improved material provided 
faster performance, even when the delay 
due to repetition of incorrectly answered 
items is not considered. The frequency 
distributions for the first cycle only are 
provided in Fig. 8. 

These data exclude the time used in re- 
peating items. Here, too, the revision pro- 
duced slightly more rapid progress. 

Such careful tailoring of material to fit 
the student is impossible with most teach- 
ing techniques. With teaching machines, 
as in no other teaching technique, the 
programmer is able to revise his material 
in view of the students’ particular diffi- 
culties. The student can write the pro- 
gram; he cannot write the textbook. 

We have seen that the principles 
evolved from the laboratory study of be- 
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havior have provided the possibility for 
the behavioral engineering of teaching. 
This new technology is thoroughly 
grounded in some of the better-estab- 
lished facts of behavioral control. The 
future of education is bright if persons 
who prepare teaching-machine programs 
appreciate this, and appropriately educate 
themselves in a special, but truly not 
esoteric, discipline. But it is vital that we 
continue to apply these techniques in 
preparing programs. The ill-advised efforts 
of some of our friends, who automatize 
their courses without adopting the new 
technology, have an extremely good 


FIG. 7. Frequency distributions for the 
median times to complete the disks or 
“lessons” for the revised (1959) and un- 
vised (1958) psychology program. Raw 
frequencies were converted to percentages 
to equate the area under the curves. From 
Holland: Teaching machines: an applica- 
tion of principles from the laboratory. 
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chance of burying the whole movement 
in an avalanche of teaching-machine 
tapes. 
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12. 
Mathetics: The Technology of Education* 


Thomas F, Gilbert 


. . . Every exercise has the same basic 
structure, regardless of content. This 
structure has its basis in behavior princi- 
ples. To understand the exercise model 
one must have an elementary grasp of 
the behavior principles of chaining and 
conditioned reinforcement. Although 
these principles are quite simple and 
obvious when understood, certain of their 
implications are so contrary to common 
thought that one must approach their 
understanding with care. 


Si——>R_ +) SR 
Lamp Pull Light Press 
cord cord on lever 


Asked how to train the rat to perform this 
sequence, the novice will advise us to be- 
gin by teaching the animal to pull the 
lamp cord; it is a well established habit to 
begin things at the beginning. In practice, 
however, the novice probably would never 
succeed in establishing this sequence. 
What would reinforce the animal even if 
he pulled the cord? A light has little value 


* From T. F. Gilbert, Mathetics: The tech- 
nology of education. J. Mathetics, 1, 7-73 
(1962). Reprinted by permission of the 
author and the Journal of Mathetics. 


The nature of behavior chaining can 
be illustrated by a simple animal training 
problem. Suppose we wish to train a rat 
to perform, in sequence, these behaviors: 


Ist operant: Pull a lamp cord to light a 
light (Sx ——>R) 


2nd operant: Press a level until a buz- 
zer sounds (Sg——>R) 


3rd operant: Go to a food pan 
(Ss——>R) 


This behavior chain can be represented in 
stimulus-response notation as: 


© S&—R + &.... 
Buzzer Approach Food 
sounds pan pellet 


to the rat. If cord-pulling were reinforced 
by feeding the animal, we would violate 
the sequential restriction which requires 
the animal to press a lever before ap- 
proaching the pan. It is well established 
in practice and in theory that the obvious 
approach of beginning at the beginning 
of the sequence is extremely inefficient; 
months and even years may be added to 
the time it should take to train an animal 
to perform such a simple sequence. 

We properly begin training our animal 
by starting with some act of mastery that 
is reinforcing to the animal. In the exam- 
ple we would begin with the act of ap- 
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proaching the food pan and finding food 
(R* S4). We then teach the animal that 
food will not be found unless a buzzer 
is sounding. He learns that whenever he 
approaches the pan with the buzzer 
sounding, he gets reinforced. Now we 
have established this much mastery: 
Ss——>R - Sy. Next, we provide for the 
lever to sound the buzzer; whenever the 
rat, in exploring the cage, presses the lever, 
he gets immediately reinforced. The im- 
mediate reinforcer is the buzzer itself; it 
is now reinforcing because it has become 
the occasion for approaching the food 
pan. Much of behavior science is based 
on this simple fact: an event that nor- 
mally has no value to an animal will be- 
come reinforcing when it sets the occasion 
for a reinforcing act; we say that this 
event has become a conditioned rein- 
forcer. With the conditioned reinforce- 
ment of the response of pressing the lever, 
we have established: R+S;——>R-° Sy. 
Next we teach the animal that the buzzer 
will not sound when the lever is pressed 
unless a light is on. Now we have Sx ——> 
R+S3——R Sq. It should be obvious 
how the remainder of the chain is pro- 
duced, and that the light has become re- 
inforcing by virtue of being an occasion 
for the buzzer working. 

The principle of chaining derives from 
a fundamental of animal nature: You can- 


ree R, * S3-——>R ° Ss——>R, e SiR, 
a q 


nya 


setup 
problem 


oe = controlling stimulus 


n = divisor d = dividend 


estimate nja 
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& place it 


not teach an animal to do anything not 
already in his repertory. The word educa- 
tion is etymologically quite correct; exist- 
ing behavior is drawn out of the animal 
and made more likely to occur again by 
consequences that are reinforcing. We 
establish the occasion (S?) on which this 
behavior gets reinforced, then make it 
possible for the animal to produce this 
occasion, and so on through the chain. 


WRITING AN EXERCISE 


Consider a simple behavior chain such 
as performing long division. This behavior 
is represented in stimulus-response nota- 
tion in Figure 1. The behavior has been 
oversimplified for illustrative purposes and 
letters are used to represent actual num- 
bers. We shall assume the student knows 
short division, basic terminology, what to 
do with remainders and how to estimate 
quotients. 

The principle of chaining tells us that 
we should first teach the student the 
terminal operant in the division chain: 
subtracting the product of quotient and 
divisor to obtain a remainder, The exer- 


FIG. 1, Long division as a behavior chain. 
(Simplified for this example.) From Gil- 
bert: Mathetics: The Technology of Edu- 
cation. 
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cises in Figure 2 are simplified to illustrate 
the basic plan of all mathematical exer- 
cises; in actual lessons, the child would 
face an exercise looking very much like 
these, but prior instruction of the type 
described in a later section would be an 
important determinant of his success. In 
Figure 2, exercise #1 establishes the 
terminal operant of the chain described 
in Figure 1. Exercise #2 establishes the 
next to the last operant, and the operant 
before this is established in exercise #3. 
The entire model for exercises can be 
shown by these three exercises. An analy- 
sis of exercise #1 will reveal the model. 
In this exercise we are establishing the 
operant S9—>R, (Subtracting to get the 
remainder). To establish this or any oper- 
ant, three things are essential: 


a) The [student] must be stimulated 
by SP (he must attend to the appro- 
priate stimulus or it is not really a 
stimulus at all). 

b) The student must make the re- 
sponse while he is under the influ- 
ence of SP. 

c) Immediately upon making the re- 
sponse, the student must see a re- 
sult that is reinforcing to him. 


In exercise #1 we have arranged 
these three conditions for the operant, 
Soke 


First: We arrange for the student to 
observe the S? (product in place 
under dividend). We do this by 
stimulating an observing re- 
sponse: (S°—->R°). In the ex- 
ercise, part (a) and the solid 
arrow together constitute the 
observing stimulus (S°). 

Second: Some stimulus existing at 
strength for the response is used 
to get the response made, Usu- 
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ally, a simple verbal instruction 
(St) is an adequate stimulus for 
this purpose. In exercise #1, part 
(b) and the broken arrow serve 
as an (S1). 

The reinforcement factor should 
be inherent in the results of 
mastery performance itself; from 
the terminal operant comes the 
end-product of mastery. It is 
necessary that the student be 
able to recognize this end-prod- 
uct. It is assumed that the 
achievement of this end-product 
is reinforcing to the student, and 
it will be if mastery is an educa- 
tional objective of the student. 


Third: 


The basic exercise mode] for introduc- 
ing a single operant can be schematized 
as: 


(S°->R°) - S— (S)—>R. 


The S° is a stimulus for an observing 
response, designed to get the student to 
observe the SP. S! is a stimulus designed 
to produce the R, and it is usually a 
simple verbal instruction. 

The observing stimulus (S°) in the 
exercise model plays two roles, each rep- 
resenting fundamental properties of per- 
ception. S° directs the student’s attention 
to SP, leading him to locate its physical 
topography. But locating the physical 
topography is not sufficient to establish 
the SP; its identity, too, must be estab- 
lished. The number 44 in exercise #1 is 
a physical form that can, and does, per- 
form many services in the experience of 
the student; it can have many identities. 
We do not want to establish R, on the 
occasion of any even number or any 
multiple of 11, but we want it to come 
under the control of any product of the 
divisor and quotient. Observing SP, there- 
fore, means not only to locate the 44, but 
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|. Divide 45 by II 


Here is what you do: a) Since 4x Il is 44, 
the 44 is placed 


4 
11745 


under the dividend ——> 44 


Now complete the long division: 


o> 


b) Subtract 44 from 45 
to get the remainder ----" 


2. Divide 28 by 12 


Here is what you do: a) \2 goes into 28 2 whole times 


b) Multiply the divisor 2 


by the quotient (12 x 2) 


12728 


and put the product 
under the dividend 


Subtract to get the remainder 


3. Divide 33 by 15 


15 goes into 33 2 whole times 


Put the 2 in place above the line 


Multiply the divisor 


by the quotient and 


15) 33 


put the product in 


its place 


d) Complete the division 


to recognize its identity in this particular 
context. The two components of the S° 
are, then, an attention-directing element 
and an identifying element, symbolized 
S° and S°, respectively. In exercise #1 of 
the example S* functions through the 
solid arrow and the statement, “the 44 is 
placed under the dividend.” The function 
of S° is carried by “4 x 11 = 44” and the 
student's observation that 4 and 11 are the 
quotient and the dividend. 


FIG. 2. Exercises in long division (simpli- 
fied) designed on the mathetical exercise 
model. From Gilbert: Mathetics: The 
Technology of Education. 


In exercise #2 of Figure 2, the next-to- 
last operant (Ss—>R,) in the chain of 
long division mastery is treated as the last 
operant was in exercise #1. The reader 
should be able to locate the S° and S! for 
this operant. In all essential respects exer- 


Behavior chain to be learned: $———>R,* S;—>R,° SR, 


Demonstrated 


Exercise Demonstrated Bi Prompted 
2 SE ERS Re 


Spontaneously 
completed 


Spontaneously 
completed 


Ro *'Sz>R3* Sz >Ra 


Spontaneously 
completed 


“SeRyeSzRySeRy 


FIG. 3. Skeleton of mathetical lesson plan. Beginning with terminal operant, each operant 
is (1) introduced with full demonstration, (2) prompted in the next exercise. (3) per- 
formed spontaneously thereafter. From Gilbert: Mathetics: The Technology of Education. 
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‘st Stage 2nd Stage 3rd Stoge 
Demonstration Prompt Release 


Sia Re 


uotient 
z r subtract 


product to get 
remainder 


Ss Ree R; 
quotient multiply q 
aly product xy subtract 
ond product 
place it ep 


R, » S-———>R, +» SR, 


estimote q 

quotient ù complete 
ond wy the long 

ploce it p division 


a multiply 
loce ond 
os long ploce 
+a oat quotient complete 
division division 


SiR; *SpR*S=R+S=R, 
set up fais t 

you long ay oie i 
division complete division 


division 


FIG. 4. Schematic of lesson plan for long division, indicating the three stages of each 
exercise in developing a behavior chain. From Gilbert: Mathetics: The Technology of 


Education. 
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cise #2 is the same as #1, except that 
#2 also deals with the last operant. After 
Ss—->R, is introduced, the exercise 
prompts the student to make the next 
response in the chain. This prompting 
stimulus, S?, is the statement, “subtract 
to get the remainder.” The purpose of this 
prompt is two-fold. As a verbal stimulus, 
it is simpler and more general than the S! 
in the previous exercise; it is a stimulus 
that the student can later give to himself 
until the SP is established at full strength 
as an occasion for the response. This is 
the mediating function of Sr. The second 
and obvious purpose of S? is to make 
certain that the terminal operant occurs 
immediately after the preceding operant, 
since it is a behavior sequence that we are 


121 


trying to establish. This is the chaining 
function of $... . 

Exercise #3 repeats the pattern estab- 
lished in #1 and #2. The third operant 
from the end is established by an S° and 
an S! and the next operant is prompted 
(Sr). This time, however, the last operant 
is not guided at all, but the student is 
released to perform on his own by some 
statement such as “complete the division.” 
All the exercises to follow would be de- 
signed according to this plan; a new oper- 
ant is introduced, the operant that fol- 
lows is prompted, the next operant is re- 
leased, and the remainder are performed 
as a natural chain of mastery. A general- 
ized lesson plan summarizing the use of 
the model is given in Figures 3 and 4.... 


13. 
A Case in and Strategy for the Extension of Learning 
Principles to Problems of Human Behavior** 


Arthur W. Staats 


. . . Relatively recently we have seen the 
extension of the principles and methods 
of leaming to more complex cases, and a 
start has been made in the application of 
the principles and procedures to the treat- 
ment of practical problems. Although the 
full development of the practical applica- 
tion phase remains largely to be done, 


there is progress in such fields as educa- 
tional psychology, clinical psychology, and 
rehabilitation. 

I think that it bears stressing to indicate 
that these applied developments make 
essential contributions to the advance of 
the science from which they spring—in 
this case learning theory. In my view, 


* From A. W. Staats, A case in and strat- 
egy for the extension of learning principles 
to problems of human behavior, Technical 
Report No. 24 under contract Nonr-2794 


(02). 
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when the principles of a science are rele- 
vant to practical problems of the world, 
one of the important criteria for evalu- 
ating the worth of the principles is the 
extent to which they aid in the solution 
of the problems. Thus, one way of further- 
ing learning theory is to validate its princi- 
ples and procedures within the context of 
solving a practical problem of behavior. 

I would expect these extensions of 
learning principles and methods to in- 
volve the following steps: (1) a learning 
analysis of the behavior and the circum- 
stances under which it is acquired, (2) a 
demonstrational-type of experiment to 
verify the most significant principles in 
the area of study, (3) more systematic 
exploration of the various principles in- 
volved in that area, (4) the final applica- 
tion of these principles and the proce- 
dures which have been developed to the 
solution of the practical problems in the 
area. 

It is in this mold that I consider the 
work I would like to report today—a proj- 
ect concerning the analysis of reading 
which has extended over a period of sev- 
eral years, I would like to use my experi- 
ence on this project to suggest a general 
strategy with which to approach the ex- 
tension of learning principles and proce- 
dures to the solution of problems of 
human behavior. To begin with, the be- 
havioral analysis of the acquisition of a 
reading repertoire was based upon Skin- 
ners (1957) interpretation of what he 
calls textual responses—operant vocal re- 
sponses under the discriminated control of 
a printed or written verbal. 

In our extension of this notion (Staats 
and Staats, 1962), we considered the 
acquisition of reading to involve getting 
the child to emit an appropriate vocal 
response while looking at a particular 
verbal symbol, then reinforcing the re- 


sponse. This training should establish the 
verbal symbol as a discriminative stimulus 
which controls the vocal response. 

As part of the analysis we considered 
the way speech itself is acquired as com- 
pared to the way a reading repertoire is 
established, and it appeared that reading 
training is not nearly as propitious. Read- 
ing training, unlike what would be recom- 
mended by a learning analysis, is relatively 
intensive, and at the same time in- 
volves poor conditions of reinforcement— 
cause enough for many failures of train- 
ing. Thus, as a first step, the analysis sug- 
gested that there are problems of train- 
ing which might be eased by a better 
understanding of reinforcement within 
the context of reading acquisition. 

The next step in the project was a 
demonstrationa) study which would 
grossly test the importance of reinforce- 
ment in this type of learning. In addition, 
such a study would explore the experi- 
mental population, and commence the 
development of procedures and apparatus. 
For this study (Staats, Staats, Schutz, and 
Wolf, 1962) a small group of words was 
arranged in a program in which words 
were presented singly as well as in sen- 
tences and in short paragraphs. The child 
was prompted to say a word as he looked 


1 The present paper formed the basis for 
a lecture delivered on May 16, 1963, by 
the author, as part of a series held at the 
Palo Alto Veterans Administration Hospi- 
tal. The series which was organized by 
Leonard Krasner and Leonard P, Ullmann 
will be edited by them and published by 
Holt, Rinehart and Winston. The lec- 
ture was entitled “Laboratory Study of 
Reading Acquisition: A Case in the 
Analysis of Complex Human Behavior.” 
The project which is described herein is 
supported by the Office of Naval Research 
under contract Nonr-2794 (02). 


LEARNING PRINCIPLES AND HUMAN BEHAVIOR 


at it, and was reinforced with small 
edibles, trinkets, or tokens backed up by 
small toys. Eight 40-minute training ses- 
sions were presented to the children and 
the number of new words the children 
learned to read was tested after each train- 
ing session. 

Three four-year-old children were intro- 
duced to the training without extrinsic 
reinforcement—they were given social re- 
inforcers (i.e. approval) but not the 
other reinforcers. This was continued 
until the child requested discontinuance 
of the activity, which was only 15 min- 
utes for two of the children and 15 min- 
utes into the second session for the other 
child. At this point reinforcement was in- 
stated and in each case the child’s reading 
behavior was strengthened and main- 
tained for the remainder of the training. 
The records of these children are shown 
in Fig. 1. These children acquired 16, 17, 
or 17 word reading vocabularies in the 
eight training sessions. 

Three other children were given the 
opposite treatment. That is, they were 
started under the reinforcement condi- 
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tion and after two training sessions were 
switched to no-reinforcement. As the fig- 
ure shows they learned words readily 
under reinforcement, but when it was 
“cut off,” their learning behaviors extin- 
guished. After three or four sessions of 
no-reinforcement each child requested 
discontinuance and the condition was 
changed to reinforcement. In two cases 
the reading behavior was re-conditioned 
and learning “picked up” again. The rec- 
ords of these children are presented in 
Fig. 2. 


FIG. 1. The curves shown here were 
generated under a beginning period of no 
“extrinsic” reinforcement, When S would 
no longer remain in the experimental situ- 
ation, reinforcement was instated as indi- 
cated by the mark on the curve. The 
dotted line commences at the point S 
would no longer remain in the experi- 
ment, and indicates the curve which 
would have resulted if reinforcement was 
not introduced. From Staats, A., A case 
in and strategy for the extension of learn- 
ing principles to problems of human be- 
havior. 
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Cumulative records 


—-—--— Extrapolated extinction curves 


Number of textual responses acquired 


TeS iS E fa 


Sessions 
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The results showed that when reading 
was reinforced attentional and work 
habits were strong and new words were 
learned rapidly, but both types of be- 
havior deteriorated when reinforcement 
was not forthcoming. Thus, it would ap- 
pear that under more appropriate condi- 
tions of reinforcement, even very young 
children are capable of sustained work 
activities and can learn complex verbal 
skills. 

While the relevance of the basic princi- 
ples and the general approach received 
support in this first study, and some of 
the requirements for a more systematic 
study were indicated, the experiment can 
be considered to be of a demonstrational 
nature. The second step in the application 
of learning principles appeared to be the 
construction of a laboratory facility within 
which to make a systematic assessment of 
principles important in read’ig acquisi- 
tion. For this we needed a g.-d depend- 
ent variable, that is, a suitable index of 
the child’s behavior which was sensitive 
to the manipulation of important experi- 
mental conditions. We also needed con- 
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FIG. 2. For these Ss, the first condition 
included reinforcement which was discon- 
tinued at the point of the first mark on 
the curve. When S would no longer re- 
main in the experimental situation, rein- 
forcement was reinstated, as the second 
mark on the curve indicates. The dotted 
line commences at the point the S would 
no longer remain in the experiment and 
depicts the curve which would have re- 
sulted if reinforcement was not reinstated. 
From Staats, A., A case in and strategy 
for the extension of learning principles to 
problems of human behavior. 


trol of irrelevant conditions, and a situa- 
tion within which the child’s behavior 
could be studied over an adequate length 
of time. 

I'll spend a moment describing some of 
the essential constituents of that develop- 
ment. First, the dependent variable in the 
initial study was the number of reading 
words acquired, as measured after each 
training session. Qualitative observations 
of the children’s behavior in the learning 
situation, however, indicated that basic to 
learning to read are the minute-to-minute 
attentional and working behaviors of the 
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child. When the child attended to the 
material and worked at a high rate, he 
acquired new words rapidly. A record of 
these actual reading behaviors should re- 
sult in a much more sensitive tool for test- 
ing the effects of different variables upon 
the learning. Accordingly, an experi- 
mental procedure was developed so that 
each reading response was automatically 
and cumulatively recorded by standard 
operant conditioning apparatus. 

With reference to the control of irrele- 
vant conditions, in the first study the ma- 
terials were heterogeneous, consisting 
sometimes of words, sometimes of sen- 
tences, and sometimes of paragraphs. 
With the development of a minute-to- 
minute recording system it was necessary 
to have reading materials which them- 
selves would not impose characteristics 
upon the child’s rate of response. Thus, a 
program was developed consisting of 
single vowel and consonant-vowel combi- 
nations. Although the letters still differ 
somewhat in stimulus complexity or dis- 
tinguishability from other letters, response 
variability was markedly decreased. 

In addition, an apparatus for the pres- 
entation of the stimuli was required. In 
the first experiment the stimuli were 
simply presented by hand, and conse- 
quently with a good deal of variation. The 
stimulus presentation apparatus which we 
later developed consists of a panel with 
four windows, each covered with a piece 
of plexiglass. One window is centered 
above the other three, as shown in Fig. 3. 
Pressure on any of the plastic covers acti- 
vates a switch. 

The verbal stimuli are presented to the 
child in a discrimination procedure. The 
top stimulus is matched by one of the 
three stimuli in the bottom row of win- 
dows. The child’s task is to select the 
stimulus which matches the one in the 
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top window. In the procedure the stimuli 
are presented, and the experimenter, who 
is almost entirely hidden from the child, 
“names” the top stimulus after the stimu- 
lus has been presented for 10 seconds. 
The child must echo the name and press 
the plastic cover on the window. He must 
then select the matching stimulus from 
among the bottom windows, say the 
stimulus name again and press the plastic 
cover. When this response occurs cor- 
rectly, the child is automatically and im- 
mediately reinforced. An error at any 
point in the chain automatically activates 
the apparatus so that the child must begin 
the trial over from the beginning—this in- 
sures that only correct responses are rein- 
forced. Since the verbal stimuli are peri- 
odically repeated, after a time the child’s 
vocal response may come under the con- 
trol of the stimulus and the child may 
without prompting emit the appropriate 
sound within the 10-second delay period. 
In this case the child is immediately rein- 
forced and does not have to go through 
the whole chain of responses. 

While the reinforcement system used 
in the demonstrational study was ade- 
quate for that purpose, the results over 
the eight training sessions indicated that 
the effect of the reinforcers was weaken- 
ing. Repertoires like speech itself, writing, 
spelling, and mathematics, etc., as well as 
reading, are acquired only over a very long 
period of time, however, with a great deal 
of training required. The problem of rein- 
forcement in long-term studies with chil- 
dren has been severe, however, as other 
investigator’s have also found (e.g., Long, 
Hammack, May and Campbell, 1958). 
Children cannot, of course, as in labora- 
tory studies with animals, be deprived of 
food for long periods of time and kept at 
reduced body weight, so that research 
may be conducted. And we can’t use the 
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FIG. 3. The laboratory apparatus for the 
experimental study of reading behavior. 
The child is seated before the center panel 
within easy reach of the various manip- 
ulanda which are involved in the read- 


withdrawal of aversive stimulation as a 
source of reinforcement. One of the things 
we see on the basis of naturalistic observa- 
tion, however, is that tokens, like money, 
become excellent reinforcers for people— 
even without states of deprivation for pri- 
mary reinforcers. This occurs because 
money is paired with, or backed up by, 
a large number of other reinforcers. Tak- 
ing this tip from everyday life, a reinforcer 
system following the same principle was 
developed. This consisted -of tokens 
backed up by various items which the 
children had previously selected—the ratio 
of tokens to back-up reinforcers dictated 


ing response sequence, Letter stimuli 
appear in the small plexiglass windows in 
front of the child whenever he activates 
the pushbutton on the table before him. 
If a correct reading response sequence 
then occurs, the marble dispenser located 
at the child’s near-right drops a marble 
into a tray positioned at its base. To the 
chiid’s left is an open bin in the Universal 
Feeder cabinet into which are delivered 
trinkets, edibles, or pennies, whenever 
the child deposits a marble in the funnel 
located atop the marble dispenser. A 
marble may also be “spent” for toys 
displayed at the child's far-right. When- 
ever the plexiglass tube beneath a toy 
is filled with marbles the child receives 
that toy. An intercom speaker at the 
child’s left allows his vocal behavior to 
be monitored from outside the experi- 
mental chamber. The light at the top of 
the center panel was not used in this 
study. From Staats, A., A case in and 
strategy for the extension of learning 
principles to problems of human behavior. 
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by the capacity of the tube in which the 
tokens are deposited (see Fig. 3). 

The next step in the experimental 
analysis of reading acquisition was to test 
the combined apparatus and procedure. 
While each phase of developing the 
laboratory facility involved pilot work, it 
was important to determine whether the 
entire system would maintain the child’s 
behavior for a long enough period of time 
to study significant variables in the learn- 
ing process, to see if the stimulus ma- 
terials and apparatus produced control of 
attentional responses, to establish the 
feasibility of cumulative recording, and to 
note the sensitivity of the records, and so 
on. The learning curves of two children 
run for 40 daily twenty-minute training 
sessions under conditions of continuous 
reinforcement will be presented (Staats, 
Minke, Finley, Wolf and Brooks, 1964). 
The first child’s record is one of great 
consistency following the preliminary 
training sessions (see Fig. 4). For this 
child the tokens appeared to immediately 
constitute strong and invariant rein- 
forcers, That is, this child customarily 
deposited his tokens in the tubes for the 
larger toys, which meant that several 
times his behavior was maintained for as 
many as three daily sessions with no 
back-up reinforcers—only tokens. The sec- 
ond child’s working behavior in the read- 
ing training was more variable, including 
pauses of various intervals (see Fig. 5). 

The results for these children indicate 
that the various procedural developments 
were functional in producing a labora- 
tory situation within which to study the 
complex human learning of a reading 
repertoire. Long-term studies now appear 
to be possible as each of these two chil- 
dren emitted about 1500 reading re- 
sponses in the 40 days of training. 

The next step in the systematic analy- 
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sis was to use the laboratory facility to 
begin to assess variables important to the 
acquisition of the behavior. As part of 
this, also, there was the need to test the 
extent to which the facility was well 
enough controlled to be sensitive to the 
manipulation of important independent 
variables. 

An important variable needing more 
systematic study concerns the schedule of 
reinforcement. We know from more basic 
studies that certain schedules of reinforce- 
ment will produce better working be- 
haviors than others. On a practical level 
of dealing with children’s learning, can 
we improve the rate of response by rein- 
forcement scheduling variables when com- 
plex learning is involved? Related to this 
is also a second goal of improving the 
reinforcer system. That is, it would be 
advisable to minimize the delivery of re- 
inforcers to prevent satiation. Anything 
which postpones satiation can be consid- 
ered to increase the effect of the reinforcer 
system, and intermittent reinforcement 
would reduce reinforcer expenditure. 

Our next study (Staats, Finley, Minke, 
and Wolf, 1964), using additional chil- 
dren, was oriented towards these ques- 
tions. We applied two different schedules 
of reinforcement to each of our subjects 
and compared rates of response under 
each schedule. The procedure was that of 
discrimination learning: the child was re- 
inforced in one manner under one room- 
light condition, and in another manner 
under another room-light condition. These 
light-reinforcement conditions were alter- 
nated during each training session in a 
manner which has been referred to as a 
multiple schedule (Ferster and Skinner, 
1957; Orlando and Bijou, 1960). 

The first child was run under continu- 
ous reinforcement for one light condition 
and under extinction—no reinforcement 
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FIG. 4. Cumulative records by sessions for Subject #1. Responses made prior to point 
X in Session 2 are those occurring during various pretraining phases. Point X marks the 
beginning of the actual reading task. The slash marks located on the line below each curve 
represent the presentation of various back-up reinforcers. A indicates that a $.10 toy was 
exchanged for 10 marbles; B marks the presentation of a $.35 toy in exchange for 35 
marbles; the child’s exchange of 80 marbles for a toy is denoted by a C; D marks the 
exchange of 150 marbles for a toy; unlettered slash marks indicate that the child deposited 
a marble for some item from the Universal Feeder. From Staats, A., A case in and 
strategy for the extension of learning principles to problems of human behavior. 
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FIG. 5. The cumulative records by sessions for Subject #2. The sequence of pretraining 
tasks occurs until point X, at which time the reading program was introduced. The occur- 
rence of back-up reinforcers is indicated below each curve as on the previous subject's 
records. From Staats, A., A case in and strategy for the extension of learning principles 
to problems of human behavior. 
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—for the other light condition. We would 
expect a discrimination to develop such 
that the reading behavior would occur 
under the appropriate light condition, but 
much less so under the other light condi- 
tion. That is what occurred. The records 
are shown in Fig. 6. Each reinforcement 
condition is depicted as a separate com- 
ponent after which time the recording 
pen resets to the baseline. By the sixth 
session the discrimination begins to form 
and thereafter becomes even more pro- 
nounced. We clearly see how stimulus 
conditions (in this case the light) which 
are correlated with response-contingent 
reinforcement can assume control over 
the working behaviors of the child. That 
is, when the light came on which was 
correlated with reinforcement, the child 


FIG. 6. The thirty daily session records 
for the multiple continuous reinforce- 
ment-extinction (mult CRF-EXT) subject 
show the reading response rates for the 
various experimental conditions, Re- 
sponses prior to point A occurred during 
the pretraining phases of the study. At 
this point the reading program was in- 
troduced under CRF. Beginning with 
Session 4 each 20-minute reading session 
commenced with a CRF component which 
then alternated with EXT conditions. The 
event marker on the line below each 
record indicates the delivery of a back-up 
reinforcer: J notes the exchange of 10 
marbles for a $.10 toy, o notes the pres- 
entation of a $.35 toy in exchange for 35 
marbles, and unlettered event marks indi- 
cate the exchange of 1 marble for an item 
from the Universal Feeder. From Staats, 
A. A case in and strategy for the exten- 
sion of learning principles to problems of 
human behavior. 
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FIG. 7. Composite record for the mult 
CRF-EXT subject. In order to make a 
comparison between an S’s response rates 
for the two experimental conditions the 
records for reinforcement schedules were 
separated and recombined to yield an indi- 


immediately began responding more rap- 
idly. When the light condition changed, 
reading behavior deteriorated. The dra- 
matic nature of the discrimination is 
shown even more clearly in the Fig. 7, 
where the responses under each reinforce- 


vidual curve for each condition according 
to daily session sequence. All records 
commence with the introduction of the 
reading program. The composite records 
for the four Ss are directly comparable; 
however, the size of each record is deter- 
mined by S’s response rate. Fig. 7 shows 
that for the mult CRF-EXT S the EXT 
rate was initially the higher rate, but at 
point A it declined and crossed the CRF 
curve. The CRF response rate was rela- 
tively rapid and stable throughout the 
experiment, From Staats, A., A case in 
and strategy for the extension of learning 
principles to problems of human behavior. 
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ment condition are pieced together so 
that the two performances can be com- 
pared to each other over the 30-session 
training period. The records of the next 
three children to be described will also be 
of this latter type. 

The second subject was run in a similar 
manner under continuous reinforcement 
and variable-ratio reinforcement—in the 
final training sessions the variable-ratio 
schedule had reached an intermittency of 
one reinforcer for an average of five re- 
sponses. Higher rates of response were 
produced under the intermittent schedule 
—using, of course, fewer reinforcers (see 
Fig. 8). The third child’s results include 
responding under continuous reinforce- 
ment and variable interval reinforcement 
where the first response the child made 
after an average of 2 minutes had passed 
was reinforced. As would be expected, the 
child’s reading response rate was lower 
under the variable-interval condition than 
under continuous reinforcement (See 


Fig. 9). 
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Fig. 10 shows the record of a child run 
under the variable ratio and variable inter- 
val reinforcement conditions. As the re- 
sults show, no discrimination between the 
two conditions was exhibited. This 
seemed to be an artifact of the procedure, 
however. This child “anticipated” almost 
none of the letters, waiting 10 seconds 
until the letter-name was given by the ex- 
perimenter. As a consequence, his rate of 
response was limited and both reinforce- 
ment schedules had him performing 
maximally within that limitation. 

It thus appears that scheduling variables 
are important, and that the response rate 


FIG. 8. Composite record for the multiple 
continuous-variable ratio reinforcement 
(mult CRF-VR) subject. The VR curve 
(shown with slash marks on the record) 
was initially lower than the CRF curve. 
However, from point A the VR rate is 
the more rapid of the two. From Staats, 
A., A case in and strategy for the ex- 
tension of learning principles to problems 
of human behavior. 


ue 


FIG. 9. Composite record for the multiple 
continuous-variable ratio reinforcement 
(mult CRE-VI) subject. The VI curve 
(with slash marks) is depicted above the 
CRF curve until point A on the record, 
at which point it becomes the lower of the 
two curves. From Staats, A., A case in and 
strategy for the extension of learning prin- 
ciples to problems of human behavior. 


FIG. 10. Composite record for the mul- 
tiple variable ratio-variable interval rein- 
forcement (mult VR-VI) subject. The 
VI curve begins lower than the VR curve 
until point A, then crosses and remains 
above the VR curve until point B, at 
which point the VI rate declines. From 
Staats, A., A case in and strategy for the 
extension of learning principles to prob- 
lems of human behavior. 
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and the efficacy of the reinforcer system 
may be increased by intermittent rein- 
forcement. The results also indicated that 
the experimental situation was sensitive to 
the manipulation of experimental varia- 
bles, producing results generally parallel- 
ing those found with sub-human organ- 
isms and more simple responses. 

At the present time, on the basis of 
what has already been found by the proj- 
ect, I plan to extend the research in sev- 
eral different directions—some of which 
are already well underway. One direction 
concerns the further investigation of some 
basic variables whose importance has been 
suggested in the progress of the experi- 
mental analysis of reading. For example, 
our procedure uses a token system. The 
responses of the child are reinforced with 
marbles, which may be exchanged for 
various back-up reinforcers. In our early 
procedure the tokens were backed up by 
the reinforcers on a 1-to-24 basis. We 
noticed at that time that this had an 
effect upon the reading behavior of the 
child which was analogous to a fixed-ratio 
pause after the delivery of a reinforcer. 
Thus, there seem to be scheduling effects 
which depend upon the way tokens and 
back-up reinforcers are related, in addition 
to the schedules involving the manner in 
which tokens (or conditioned reinforcers) 
are made contingent upon the behavior of 
the organism. Although this has not been 
systematically investigated in basic animal 
studies (and should be), it would thus 
seem that there are two types of schedules 
which combine to produce effects upon 
the organisms rate of response. Ultimately, 
we would like to study the effect on read- 
ing performance of the “schedule” by 
which our tokens are backed up by the 
other reinforcers. 

Another suggestion for basic research 
that we have from our experiments 


emerges from the work on the effects of 
multiple schedules on the maintenance of 
the reading behavior. This can be seen 
easily in Table 1. Although these results 
can only be considered as suggestive be- 
cause of the number of subjects run as 
well as some of the control aspects of the 
procedure, the three continuously rein- 
forced children do not respond at the rate 
exhibited by each of the children under 
the various multiple schedules. Even the 
child under the variable ratio and variable 
interval schedule responds at a greater rate 
than the continuously reinforced children 
—and with far less reinforcement, one 
token for 3.72 responses versus one for 
each response. In addition, there is con- 
siderable variance between the rates of 
the various children under the several 
multiple schedules (see Table 1), an aver- 
age of 58.8 for the CRF-EXT child, 53.6 
for the CRF-VR child, 44.8 for the CRF- 
VI child, and 42.4 for the VR-VI child. 
This suggests that the rates of response 
per reinforcer produced under different 
multiple schedules should be systemat- 
ically studied. Previously multiple sched- 
ules have been used as a method for study- 
ing individual components—rather than 
being studied themselves for the over-all 
rates which they produce. We have com- 
menced pilot work to study the relative 
qualities of different multiple schedules 
for practical learning situations, i.e., the 
ability of the multiple schedule to main- 
tain vigorous behavior with little reinforce- 
ment. 

These two avenues of research are cited 
since it is rather interesting that these 
indications for basic study have emerged 
in the process of studying a complex hu- 
man behavior. 

Another direction of research concerns 
the implications of our use of experi- 
mental designs in long-term studies of 
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children engaged in complex learning. 
Because of the complexity of the learning, 
behaviors such as reading cannot be as- 
sessed in short-term group studies. Re- 
liable results were obtained over a lengthy 
period, however, using the multiple sched- 
ule design where two conditions were 
presented to the same child. This design 
can be applied to the assessment of other 
independent variables besides those of 
reinforcement schedules. The different 
effects of reading materials could also be 
assessed. That is, using the multiple 
schedule design we will be able to present 
the same child with two different types of 
reading program and record the child’s 
rate of learning under each condition. 
Thus, as a gross example, whole-word 
presentation could be compared to pho- 
netic presentation in conditions of good 
laboratory control. This type of investi- 
gation should yield a deeper understand- 
ing of reading acquisition. 

Another line of research in which I 
will move is in the application of the pro- 
cedures and principles to the study of 
learning in special populations of children. 
We hope soon to have some experiments 
going with mental retardates—first, just to 
see how the procedures transfer to this 
new population, and later, perhaps, to 
establish some of the learning differences 
between retardates and normals in this 
significant type of human learning. The 
methods could also be used with other 
special problems of children, eg., deaf 
children, autistic children, and so on. 

Lastly, I have been extending the re- 
search to the solution of some of the 
problems involved in actually teaching 
reading. I’m not prepared at this moment 
to present the results in detail, but I have 
already taught one child the rudiments of 
reading at the age of three years and two 
months (and the procedures are now 


being extended to other children), This 
child has a reading repertoire of almost all 
the lower case and capital letters as well 
as thirty-two words (including the vari- 
ants of one word, e.g., drives and drive 
are counted as two words). This child 
(our daughter) reads the words alone and 
in sentences and short paragraphs. The 
following is a sample paragraph: 


Jenni drives to a zoo. 
Jenni plays at the zoo with a girl. 
Jenni and the girl eat at the zoo. 


In conclusion, although I am not sug- 
gesting that this is the ultimate in the re- 
search which is necessary, I feel fairly 
confident of the productiveness of this 
systematic analysis. Based upon the find- 
ings so far, it would seem that a procedure 
and program will eventuate which will 
make more expeditious the original train- 
ing of reading in young children. 

Referring again to the general strategy 
suggested for the application of learning 
principles to significant human behaviors, 
the research project on reading has thus 
made the following progress. It com- 
menced with at least a partial behavioral 
analysis of reading and of some of the 
learning factors which contribute to the 
difficulty of training. Then several demon- 
strational studies were conducted which 
showed that the relevant principles of re- 
inforcement and discrimination did in- 
deed apply to the acquisition of reading. 
Following this, a laboratory procedure and 
apparatus were constructed within which 
the systematic study of reading could take 
place. This facility has been tested in 
studies which more systematically assess 
reinforcement variables within the con- 
text of reading. This progress has sug- 
gested additional plans for continued 
systematic analysis of reading. In addi- 
tion, as I have briefly described, I have 
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been working with the further application 
of the findings to the actual problem of 
training children to read, and should soon 
have systematic results to report. This last 
development constitutes entrance into the 
final stage of the strategy proposed in the 
introduction. 

I will now leave the field of reading per 
se and explore the implications of the 
reading project for other types of prob- 
lems of human behavior. To begin with, 
we might ask where we stand with a be- 
havioristic approach to the problems of 
human behavior. We do possess a fine set 
of principles and procedures established 
in basic studies, primarily with lower ani- 
mals, The heavyweight empirical princi- 
ples have been well substantiated a num- 
ber of times. Many of these heavyweight 
principles have been extended to human 
behavior, also in basic studies. The princi- 
ple of respondent conditioning has been 
shown to be involved in conditioning fears 
(Watson and Rayner, 1920), attitudes 
(Staats and Staats, 1958), and semantic 
properties of language (Osgood, 1953; 
Mowrer, 1954; Cofer and Foley, 1942; 
Staats, 1961). The principle of reinforce- 
ment has been shown to operate with 
verbal classes (see Krasner, 1958; Salz- 
inger, 1959), problem solving (Maltz- 
man, 1955; Adamson, 1959), social be- 
havior (Azrin and Lindsley, 1956; Ban- 
dura, 1962), attitudes (Scott, 1957), the 
learning of mental retardates (Orlando 
and Bijou, 1960), personality indices 
(Nuthmann, 1957; Staats, Staats, Heard, 
and Finley, 1962), as well as various types 
of abnormal behaviors (Ferster, 1961; 
Ayllon and Michael, 1959). 

Because of the verification of learning 
principles in these new domains of be- 
havior, we have confidence in the rele- 
vance of our principles and procedures 
and in their eventual ability to solve com- 
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plex human problems of behavior. But 
we do not have at this time a large num- 
ber of analyses of different behavior prob- 
lems, as well as long-term projects involv- 
ing systematic and applied studies of 
behavior problems. We do not, conse- 
quently, at this time have a set of pro- 
cedures for treatment to transmit to 
practitioners, Perhaps I can give some ex- 
amples of what I mean. Several years ago 
Rheingold, Gewirtz, and Ross (1959) 
conducted a study in which it was shown 
that the vocal behavior of three-month- 
old infants could be strengthened through 
response-contingent reinforcement. This 
is an important demonstrational study. 
But it also suggests that the original acqui- 
sition of speech in infants should be sys- 
tematically studied. If in a few 30-minute 
periods the vocal behavior of infants can 
be strengthened, then systematic applica- 
tion of reinforcers over a long period of 
time should result in a more rapid acqui- 
sition of speech than would otherwise 
occur. Study of this process with system- 
atic observation and recording should help 
us understand the process and lead to 
procedures which are valuable for pro- 
ducing desirable development of speech 
behavior. There is no doubt that a pri- 
mary problem of some children is their 
“backward” development of speech. 
Autistic children are notable in this re- 
spect, and it is no doubt the case that 
many children called mental retardates 
are victims of poor training histories in 
this important area. 

There are no special obstacles to this 
type of study. There are many institution- 
alized children who could only profit 
from the procedures involved in attempt- 
ing to shape good verbal behavior in 
them. Many autistic, brain damaged, men- 
tally retarded children would serve as fine 
subjects in procedures which would surely 
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improve the child’s adjustment and yield 
procedures that could be generally ap- 
plied. 

As another example, Ayllon and asso- 
ciates (Ayllon and Haughton, 1962; Ayl- 
lon and Michael, 1959) have shown that 
operant conditioning principles can be 
applied to behavior problems in psy- 
chotics. This research has also indicated 
that tokens backed up by food can be 
used as an effective reinforcer system in 
working with psychotics. The next step 
could be the use of the principles and pro- 
cedures to shape adjustive behaviors in 
psychotics. Isaacs, Thomas, and Goldia- 
mond (1960) have shown that mute 
schizophrenics could be operantly shaped 
to speak again, using only very light- 
weight reinforcers and in what constituted 
a relatively short experimental procedure. 
With these demonstrations and the use 
of a reinforcer system like that of Ayllon 
and Haughton (1962), it should be pos- 
sible to shape adjustive behavior in psy- 
chotics of a much more extensive type. 
For example, the work behaviors of psy- 
chotics should be studied in long-term 
systematic projects. Such study should 
also be applied to other adjustive social 
behaviors, language behaviors, and so on 
—any behavior in which the psychotic is 
deficient and which could be shaped 
through the manipulation of reinforce- 
ment variables. 

Again, the back wards of neuropsychi- 
atric hospitals are full of patients who 
could only profit from such treatment- 
research activities. Systematic attempts to 
shape the behavior through reinforcement 
should yield a general understanding of 
the behavior and also general programs 
and procedures for the treatment of other 
patients. 

Returning again to autistic children, 
Ferster and associates (1961) have indi- 


cated that the behavior of these children 
is subject to reinforcement principles. 
This constitutes a demonstrational study 
in that the behaviors under study were 
relatively simple, e.g., bar-pressing. The 
behavior problems of children should 
generally be approached using behavioral 
methods, since many such problems in- 
volve learning. Actually, these applica- 
tions are accruing. Several years ago 
Williams (1959) showed that temper 
tantrums could be treated by extinction 
procedures. More recently this has been 
extended by Wolf, Mees, and Risley 
(1963) with a child diagnosed variously 
as mentally retarded, schizophrenic, and 
brain-damaged. Several different behav- 
iors were modified in this child by means 
of learning treatments, resulting in 
marked improvement in the child’s adjust- 
ment. 

These studies may be considered to 
have moved past the demonstrational 
stage and into the application of learning 
principles to the solution of behavior 
problems of some importance. This suc- 
cessful treatment should be extended to a 
systematic study of various complex be- 
havior problems in children. 

One of the areas in which the applica- 
tion of learning principles has appeared to 
me to be needed is in the field of rehabili- 
tation. My discussions with therapists in 
this field have suggested that much of 
their work, especially with children, in- 
volves training new behaviors under cir- 
cumstances in which the reinforcers are 
weak. For example, prior to developing 
skill with a prosthesis, the child secures 
reinforcement more easily for various al- 
ready learned substitution movements. 
Thus, some way must be found at first to 
supply “extrinsic” reinforcement for the 
more difficult “prosthetic responses,” 
since in a competitive sense these re- 
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sponses are not themselves “naturally” 
reinforcing. Research being conducted by 
our students at Arizona State University 
has begun to apply reinforcement princi- 
ples to such problems of training and to 
many others. For example, two students? 
have been working with a boy whose left 
arm was paralyzed through brain-damage 
and who has not responded to rehabilita- 
tion efforts since right arm movements 
serve as a substitute. The plan has been 
to reinforce the boy for left arm move- 
ments directed toward a large visual tar- 
get. As these left arm movements have 
been strengthened sufficiently, the target 
has been reduced in size until the accu- 
racy of the arm movements improved. So 
far the treatment has met with success 
using social reinforcers backed up by toys. 

Following this demonstration it has 
also been possible to achieve startling 
improvements in motor performance 
through the use of a token reinforcer sys- 
tem such as has been described herein.* 
When reinforcement was made available 
for a child who refused to walk alone, the 
desired behavior was obtained readily. The 
same was true of a child who rehabilita- 
tion specialists had been trying to train to 
fall down properly. This immediate im- 
provement coincides with my own previ- 
ous observations of some remedial reading 
cases with whom we began work in the 
process of the experimental analysis of 
reading. Although they were diagnosed as 
remedial readers by school tests, when we 
introduced response-contingent reinforce- 
ment, we obtained remarkable improve- 
ment—too remarkable to be considered 
acquisition curves. The conclusion is that 
many problems appear to be more of a 
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reinforcement problem—called motiva- 
tional problems in common sense terms. 
This means that the development of an 
appropriate reinforcer system and a 
method for its application according to 
learning principles may be the most im- 
portant step in solution of the problem, 
At any rate, we need long-range, system- 
atic studies of sensory-motor training 
procedures emphasizing the development 
and application of reinforcement proce- 
dures (see Meyerson, Michael, Mowrer, 
Osgood, and Staats, 1963, for a supple- 
mentary discussion of the use of extrinsic 
reinforcers in the field of rehabilitation). 
Another problem which can be con- 
sidered similar to those of rehabilitation 
involves the problem of stuttering which 
was dealt with in a previous lecture in this 
series by Goldiamond (1963). His work 
in this area may be considered to be a 
systematic application of certain princi- 
ples of reinforcement to the study of this 
type of behavior. In general, the princi- 
ples seem to hold well and this suggests 
that the behavior is acquired, at least in 
part, according to reinforcement princi- 
ples. The next step is to work with actual 
problems of stuttering in an attempt to 
beneficially modify the behavior of stut- 
tering and produce procedures and prin- 
ciples which have general applicability. 
Thus, at this time I think we need to 
multiply the investigators who have 
chosen a type of behavior and set about 
the experimental analysis of the behavior 
in long-term projects. We have the basic 
principles of learning and a number of 
experimental procedures for applying the 
principles to the problems of individuals. 
But the fact remains that we need many 
more experimental analyses of behavior 
problems which are carried as far as they 
can go in the solution of complex human 
behavior problems. With reference to 
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these needs, I’d like to describe more fully 
the previously mentioned four steps which 
seem to be involved in such long-term 
studies. 

To begin the extension of basic learning 
principles to a complex human behavior, 
it seems necessary to make a learning 
analysis of the behavior involved. This 
analysis can be of several types. One way 
is to begin with systematic observations 
of the behavior. This might be elaborated 
to include observations of the reinforcers 
which are acting upon the behavior, as 
well as deprivation and satiation opera- 
tions which affect the reinforcers, and 
also the way the reinforcers become rein- 
forcing, if conditioned reinforcers are in- 
volved. The discriminative stimuli which 
have come to control the behavior may be 
important. This may include various types 
of stimuli—environmental, response-pro- 
duced, interoceptive, and so on. The be- 
havior in which one is interested may 
actually be a complex chain itself—not a 
single, momentary response. ‘The observa- 
tions should include reference to compet- 
ing behaviors. As both Lindsley (1956) 
and Ferster (1961) have shown, whether 
or not psychotic episodes occur, for ex- 
ample, is a function not only of the 
strength of the psychotic behavior itself, 
but also of competing behaviors. 

But the learning analysis may not start 
with such systematic observations. Al- 
though this may be alien to some con- 
temporary investigators, analysis may first 
be of a more theoretical nature, involving 
tentative extensions of learning principles 
prior to obtaining further observations. It 
was interesting to me in skimming the 
tapes of a few of the previous lectures that 
in two cases there were vigorous denials 
of any interest in theory—yet Skinner’s 
theoretical analysis of human behavior, 
especially verbal behavior, in the absence 


of any experimental substantiation, was 
the basis of their own work. It should be 
pointed out that any extension of a learn- 
ing principle to a new domain of behavior 
is theoretical until corroborated, and can 
quite legitimately be called an hypothesis. 

The fact is that this type of analysis is 
important, and in many cases precedes 
even systematic, naturalistic observation, 
It is only a misconception of what consti- 
tutes theory in psychology which leads to 
the general rejection of analysis before 
experimentation or, as Skinner calls his 
Verbal Behavior, “exercises in interpreta- 
tion.” Tentative guesses concerning the 
types of learning variables which may have 
accounted for a behavior are more than 
empty gestures. They suggest procedures 
which when applied can verify the guess, 
or eliminate it as a possibility. Untestable 
concepts such as those which abound in 
dynamic approaches may not offer this 
advantage—but guesses in terms of empiri- 
cal principles suggest empirical applica- 
tions. 

Whether the analysis is based upon 
systematic observations or whether the 
analysis is more what we usually call 
theory, the next step in the extension of 
learning principles many times appropri- 
ately involves a “demonstrational” study. 
This means testing some of the main 
principles of the analysis in the context of 
the behavior of interest. For example, is 
reinforcement important in the acquisi- 
tion and maintenance of the behavior in- 
volved. In demonstrational studies one 
may choose to use group designs and 
statistical analyses in short-term experi- 
ments. The most expeditious way to verify 
the basic principles in the new behavior 
domain may be advisable. In any event, I 
have found that in this type demonstra- 
tional study one begins to learn more 
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about the behavior and subject population 
which is involved—and one may get ideas 
pertinent to more systematic study of the 
behavior. 

The next step is to make a more system- 
atic attempt to explore the principles in- 
volved in the acquisition, maintenance, or 
change in the behavior under study. Addi- 
tional variables may be tested at this time 
—reinforcement schedules, discriminative 
stimulus control, or what have you. The 
studies of Bijou and associates (e.g., Bijou 
and Oblinger, 1960; Bijou and Orlando, 
1961) with the operant conditioning of 
mental retardates may be considered as an 
example here. At this stage of the long- 
term study of a behavior problem, the 
attempt may be made to achieve better 
experimental control perhaps through the 
development of improved procedures or 
apparatus. If the behavior under study is 
complex, as most significant human be- 
haviors are, it can be expected that short- 
term group studies will not suffice. Pro- 
cedures will have to be worked out in 
which the behavior can be studied over a 
long period of time. We have to distin- 
guish the modification of what are actu- 
ally relatively simple behaviors or classes 
of behavior from the modification of more 
complex behaviors. It is stimulating to us, 
and a momentous step, to extinguish tem- 
per tantrums, or shape walking versus 
crawling, or shape going to bed at night 
without a fuss, or the striking of a target 
in a previously useless arm. But we have 
to realize what the nature of this progress 
in learning extensions is, as well as the 
task that lies ahead. These are impressive 
demonstrations of the relevance and ap- 
plicability of learning principles to the 
treatment of behavior problems. However, 
we can’t expect to restore the “word 
salad” of the schizophrenic to high level 
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communication and good language behav- 
ior in reasoning through a short-term pro- 
cedure. There are many behaviors—the 
original acquisition of speech, the acquisi- 
tion of reading, the development of com- 
plex social behaviors, work behaviors, so- 
called mental retardation, etc.—whiv.. are 
acquired (or are not acquired) only over 
a period of many years. We must expect 
that it will take years to change or insti- 
tute those behaviors even under good 
training procedures. 

Nevertheless, we must begin the study 
of such complex human behaviors—as 
well as the more simple ones. But a belief 
that the operant shaping of a simple be- 
havior in a short time indicates that all 
behaviors will fall into place this way, or 
that the major problems have been solved, 
is unrealistic. Although it would be ex- 
pected on the basis of our findings that 
the principles hold from rat to man, the 
repertoire to be acquired by man is fan- 
tastically complex. The task of establish- 
ing programs of training with which to 
deal with problems of complex human 
behavior lies largely ahead. 

So, the learning approach appears to be 
tremendously productive—but there is 
much to do. Which brings us to the final 
step in the extension of learning to the 
solution of practical problems of behavior. 
Based upon my research in the acquisition 
of reading, I would conclude that when 
one works over a period of years with the 
same problem of training behavior, first 
in demonstrational studies, then in other 
systematic studies, he learns a great deal 
about what can be done about some of 
the problems involved in modifying the 
behavior in a benign way. With this ex- 
perience he is better prepared to begin 
research on actual practical problems. I 
had, for example, prior to actually training 
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a child to read, very well worked out 
schemes for the procedure to be used, 
based upon my past research. 

For solving actual problems, however, 
the simple knowledge of basic learning 
principles will not provide adequate back- 
ground. Many learning theorists occupied 
solely with basic problems will confess 
quite frankly that they would not have the 
foggiest notion of how to help solve hu- 
man problems involving learning, e.g., 
how to train a child to read. I think the 
preceding steps I’ve outlined, on the 
other hand, will provide knowledge for 
approaching practical problems of behav- 
ior in quest of general solutions, 

My experience suggests, then, that it is 
important for investigators to become in- 
terested in the systematic and detailed 
study of a type of behavior and continue 
with the study over a long period of time, 
extending their progress as far as they can 
go towards the solution of the practical 
problems involved. A great deal of knowl- 
edge can be gained in the practical situa- 
tion where one attempts to modify behav- 
ior—even if the situation does not involve 
precise laboratory control. This is a point 
worth stressing, for there are many experi- 
mental psychologists of a learning orienta- 
tion who are really opposed to the applied 
extension of learning principles. Among 
them are methodological “purists” who 
feel that if you cannot achieve precise ex- 
perimental control you should not tackle 
a problem. There is also in some circles a 
denigration of applied research versus 
basic or “pure” science. Actually, how- 
ever, the full status of a science is achieved 
when it aids in the solution of practical 
problems, improving over common sense 
notions. The application of learning prin- 
ciples and methods to practical problems 
is an important way of advancing the sci- 
ence of behavior. I feel these applications 


of principles previously found in the basic 
science constitute one of the most im- 
portant types of problems in which a be- 
havioral psychologist can be involved. 

In this process one can expect that the 
first efforts will not be done with labora- 
tory precision. To expect this would be to 
place too difficult a standard for the ac- 
tivity. Successive approximations to pre- 
cision must be expected. The first devel- 
opment of a procedure may be relatively 
gross, but these early steps must be taken 
to gain further knowledge on which to 
make improvements. 

This raises some questions about the 
assessment of one’s results. If the training 
requires long-term procedures this means 
single organism research. What means 
can be used to assess results? One way is 
the one we used in the context of reading 
in which the same child was put under 
two experimental conditions and the be- 
haviors produced under each could be 
compared. In long-term studies it was pos- 
sible to produce reliable results. 

Another way is to consider the patient’s 
previous history of behavior as the base- 
line—as the control period. Then when 
learning conditions are instituted the im- 
proved behavior which results may be 
compared to the pre-treatment behavior. 
Wolf, Mees, and Risley used this method. 
They plotted the child’s behavior of wear- 
ing glasses after instituting reinforcement 
procedures—when previously the child 
could not be made to wear glasses. The 
work of Isaacs, Thomas, and Goldiamond 
in which the speech of two long-standing 
mute schizophrenics was restored by 
operant procedures is another example. 

In conclusion, the methods and prin- 
ciples of learning seem to offer the possi- 
bility for dealing with disorders of be- 
havior in a more profound manner than is 
otherwise currently available. However, it 
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is suggested that great advancements still 
lie ahead in the application of learning 
methods and principles to behavior prob- 
lems. In this task, because the general 
method of a learning psychotherapy is 
based upon the manipulation of observ- 
able independent and dependent varia- 
bles, the method should have advantages 
characteristic of other applied sciences— 
one of which is their “self-corrective” na- 
ture. That is, when working with observ- 
able events, it is evident when something 
has been accomplished and when it has 
not, where principles hold and where they 
do not, where development is still neces- 
sary, and so forth. Since learning ap- 
proaches to behavior modification are 
based upon a set of experimentally estab- 
lished principles, a development consist- 
ent with that occurring in other applied 
sciences can be confidently predicted. 
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chapter IV 


Communication and Other 
Functions of Language 


THE PREVIOUS CHAPTER dealt with the extension of conditioning principles 
to the study of language behavior deriving from a Skinnerian analysis in 
terms of operant conditioning principles. Another major learning approach 
to the study of language has its roots in the work of Clark L. Hull (for ex- 
ample, selection 21) as it has been extended by such individuals as C. N. 
Cofer and J. P. Foley, (for example, selection 22) J. Dollard and N. E. 
Miller (1950), C. E. Osgood (1953), O. H. Mowrer (1960) and Staats 
(1961). Fhis chapter attempts to present a selection which will indicate 
some of the contributions which this latter approach makes to understand- 
ing language behavior—and also to lay a foundation for some of the ex- 
tensions which occur in later sections. In addition, although this approach 
involves to a larger extent the principles of classical or respondent condi- 
tioning, an attempt will be made to show how an integration of various 
learning orientations provides a more powerful approach to the understand- 
ing of language learning and function. 

The first article to be presented is an excerpt from a classic by Hull which 
begins an S-R analysis of the manner in which chains of responses may 
mediate complex adjustive behaviors. He describes how such chains (which 
could be “symbolic,” or verbal) can occur prior to environmental events 
and in that way “anticipate” consequences. In this analysis, the concept of 
pure stimulus act is also introduced. The total formulation may be con- 
sidered to be the basis for conceptions of (and resulting experiments on) 
implicit responses which produce stimuli which mediate, or control, 
other responses. Examples occur in analyses of word meaning, sensory- 
preconditioning, attitudes, problem solving, semantic generalization, and 
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so on. Some of these topics will be discussed in later articles which are 
presented. 

The next selection, an excerpt from a paper by Cofer and Foley, sum- 
marizes a number of studies, and makes an explicit analysis of the manner 
in which responses may mediate “similarity” between stimuli which ac- 
tually differ on a physical stimulus dimension. Thus, if two stimuli which 
are physically dissimilar come through conditioning to elicit the same re- 
sponse (and its attendant stimulus properties), experience with only one 
of the stimuli will generalize to the other. Cofer and Foley describe this 
ability to mediate generalization as one of the important functions of 
language behavior. Further elaboration of this function will occur in later 
papers. 

Phillips’ study is a sophisticated verification and extension of these prin- 
ciples of semantic generalization. Other studies have used natural synonyms 
with which to test the expectations that meaning is a response and, conse- 
quently, that when two words have the same meaning, experience with one 
will generalize to the other. Phillips, instead of depending upon natural 
synonyms, actually develops word synonyms in the laboratory by condi- 
tioning similar responses to the words. 

Osgood has developed a general theory of learning which is congruent 
with these concepts and experimental results and explicitly discusses how 
word meaning may be considered in terms of learning principles. Although 
the excerpt by Osgood is short, it sets forth what has in contemporary 
psychology become a powerful approach to language. 

Mowrer takes the theory and the empirical developments of semantic gen- 
eralization and extends the principles into a consideration of the actual act 
of communication—the manner in which past S-R processes may function in 
producing new learning, solely on the basis of language. He describes the 
basic act of communication as classical conditioning of the meaning 
response elicited by the predicate word (or words) in a sentence to the 
subject word, as well as to the meaning response elicited by the subject 
word. Many new implications concerning important personal and inter- 
personal functions of language are thereby suggested. 

The next article, by the present author, indicates that acts that are 
commonly called communication include additional principles of learning 
not suggested in the preceding article. Mowrer’s analysis could be said to 
derive from a Hullian theoretical framework. On the other hand, the oper- 
ant conditioning approach to language seems also to offer principles which 
are important to verbal communication. Several types of operant condition- 
ing verbal mechanisms are described, and how these mechanisms can func- 
tion in controlling appropriate behavior as well as in producing new learn- 
ing is discussed. It is also suggested that an integration of S-R principles, 
methods, and findings forms a more powerful approach than the separatist 
tendencies promoted by different “theoretical” positions. The productivity 
of an integrated S-R approach will be suggested again later in this chapter 
as well as in some of the chapters that follow. 
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The area of verbal learning which has used the methods of paired asso- 
ciate and serial learning has contributed a vast experimental literature. For 
the most part, however, the methods of experimentation have been used 
in basic research in the attempt to find basic, analytic principles of learn- 
ing. It is suggested that a necessary and important future development of 
the field of verbal learning will be the application of its methods to the 
study of relevant facets of language development and function, in addition 
to the study of basic principles. 

Skinner (1957) has suggested that important aspects of language involve 
intraverbal responses or word associations (although he did not indicate the 
relationship of his discussions to the experimentation on word associa- 
tions). The present author (Staats and Staats, 1963) has also discussed the 
importance of word response sequences in areas such as intelligence de- 
velopment, grammatical verbal construction, problem solving, and scientific 
and social reasoning. It is suggested that the apparatus and procedures of 
paired associate and serial learning seem ideally suited for the study of such 
problems of complex language behavior. 

It is primarily for this reason that the next study of Russell and Storms 
is a classic. It begins to experimentally study the function of word associa- 
tions. In addition, the study also deals with the important concept of the 
implicit mediating response—in this case, an implicit word response. The 
results indicate that word responses under the control of other word re- 
sponses (or the stimuli they produce) may be implicit and yet mediate 
other responses that they control. This study can be considered a paradigm 
for some types of implicit thinking. 

Thus far, in Chapters III and IV, several different approaches to lan- 
guage have been represented in the selections, for example, operant con- 
ditioning, mediating responses, and word associations. As previously men- 
tioned, the findings of these different orientations have tended to remain 
strictly separate. However, the principles and methods of operant con- 
ditioning studies of verbal responses, those of semantic generalization and 
semantic conditioning studies, and those of word association studies, when 
combined, appear to offer a stronger experimentally based learning ap- 
proach to language. The possibility of this type of integration of research 
and theory is further suggested in the next two articles in this section. 
The first article summarizes a conception of conditioned reinforcement in 
terms of respondent conditioning principles. With this as the basic theory, 
it is possible to integrate the concepts and experimental findings of studies 
of word meaning stemming from a Hullian framework with the concepts 
of operant conditioned reinforcement as it is related to language acquisition 
and function. This integration has implications for areas yet to be pre- 
sented in the book, for example, attitude development and social inter- 
action. 

The last article also indicates the possibility of the integration of research 
and theory within the context of discussing the development and function 
of word classes as described in the introduction to Chapter III. In addition, 


Communication 


148 


another very important function of verbal behavior is discussed—the man- 
ner in which chains of verbal responses may mediate behavior which 
“anticipates” future events (that is, purpose). The verbal mechanism of 
word response chains will be important in understanding the section on 
problem solving and reasoning (Chapter IV). 


14. 
Knowledge and Purpose 
as Habit Mechanisms * 


Clark L. Hull 


It is only with the greatest difficulty 
that scientists are able to maintain a 
thoroughly naturalistic attitude toward 
the more complex forms of human be- 
havior. Our intellectual atmosphere is 
still permeated in a thousand subtle ways 
with the belief in disembodied behavior 
functions or spirits. The situation is 
aggravated by the fact that the details of 
the more complex action patterns are so 
concealed as to be almost impossible of 
observation. Even so, the outlook is hope- 
ful. The work of many ingenious investi- 
gators is bringing to light important de- 
tails of the hidden processes, and enough 
evidence has already accumulated to en- 
able us in a number of cases to discern 
with tolerable clearness the broad natural- 
istic outlines of their operation. 


One of the oldest problems with which 
thoughtful persons have occupied them- 
selves concerns the nature and origin of 
knowledge. How can one physical object 


become acquainted with the ways of an- 
other physical object and of the world in 
general? In approaching this problem 
from the point of view of habit, it is im- 
portant to recognize that knowledge is 
mediated by several fairly distinct habit 
mechanisms. In the present study but one 
of these will be elaborated. 

Let us assume a relatively isolated in- 
organic world sequence taking place as 
shown in Fig. 1. Here Sj, Se, etc., repre- 
sent typical phases of a sequential flux, 
the time intervals between successive S's 
being uniform and no more than a few 
seconds each. Let us suppose, further, 
that in the neighborhood of this world 
sequence is a sensitive redintegrative or 
ganism. The latter is provided with dis- 
tance receptors and is so conditioned at 
the outset as to respond characteristically 
to the several phases of the world se- 
quence. Each S accordingly becomes a 
stimulus complex impinging simultane- 
ously on numerous end organs. As a re- 


* From C. L. Hull, Knowledge and pur- 
pose as habit mechanisms, Psychol. Rev., 
37, 511-525 (1930). Reprinted by per- 
mission of the American Psychological 
Association. 
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The World: 


Santee 


sult, each phase of the world sequence 
now becomes a cause, not only of the suc- 
ceeding phase in its own proper series, 
but also of a functionally parallel event 
(reaction) within the neighboring organ- 
ism, The organismic responses of the se- 
ries thus formed have no direct causal re- 
lationship among themselves. R; in itself 
has no power of causing (evoking) Rə. 
The causal relationship essential in the 
placing of Ry after R, is that of the phy- 
sical world obtaining in the S-sequence; 
Rə follows Ry because Sẹ follows Sy. The 
situation is represented diagrammatically 
in Fig, 2. 

Now a high-grade organism possesses 
internal receptors which are stimulated 
by its own movements. Accordingly each 
response (R) produces at once a char- 
acteristic stimulus complex and stimuli 
thus originated make up to a large extent 
the internal component of the organism’s 
stimuli complexes. Let these internal 


1 This neglects the original dynamic in- 
fluence of the ever-present internal com- 
ponent of the organismic stimulus complex 
into which each phase of the world se- 
quence enters to evoke the corresponding 
organismic reaction. The excitatory potency 
of this internal component is here supposed 
to be minimal. Its influence is neglected 
in the interest of simplicity of exposition. 
Its undeniable presence clearly introduces 
an element of subjectivity into reactions 
which appear superficially to be evoked 
purely by the external world. 
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FIG. 1. From Hull: Knowledge and pur- 
pose as habit mechanisms. 


stimulus components be represented by 
s’s. If we assume, in the interest of sim- 
plicity of exposition, that the time inter- 
vals between the phases of the world flux 
selected for representation are exactly 
equal to those consumed by the S> 
R — s sequences, the situation will be as 
shown in Fig. 3, Sə coinciding in time 
with sı, Ss with sə and so on. 

Now, by the principle of redintegra- 
tion, all the components of a stimulus 
complex impinging upon the sensorium 
at or near the time that a response is 
evoked, tend themselves independently to 
acquire the capacity to evoke substantially 
the same response. We will let a dotted 
rectangle indicate that what is enclosed 
within it constitutes a redintegrative 
stimulus complex; and a dotted arrow, a 
newly acquired excitatory tendency. After 
one or more repetitions of the world se- 
quence, the situation will be as shown in 
Fig. 4. 

As a result of the joint operation of the 
several factors summarized in Fig. 4, the 
organismic reactions (R’s) which at the 
outset were joined only by virtue of the 
energies operating in the outer world se- 
quence of $’s, are now possessed of a gen- 
uine dynamic relationship lying within 


FIG. 2. From Hull: Knowledge and 
purpose as habit mechanisms. 
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FIG. 3. From Hull: Knowledge and 
purpose as habit mechanisms. 
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the organism itself. To make this clear, FIG. 4. From Hull: Knowledge and 


let it be assumed that the world sequence 
begins in the presence of the organism, 
but is at once interrupted. The resulting 
situation is shown diagrammatically in 
Fig. 5. The newly acquired excitatory 
tendencies, unless interrupted by some 
more potent influence, should continue 
the organismic sequence of responses very 
much as when they were first called forth 
as the result of the stimulation by the 
world sequence. 

In summary it may be said that through 
the operation of a variety of principles 
and circumstances, the world in a very 
important sense has stamped the pattern 
of its action upon a physical object. The 
imprint has been made in such a way 
that a functional parallel of this action 
segment of the physical world has become 
a part of the organism. Henceforth the or- 
ganism will carry about continuously a 
kind of replica of this world segment. In 


The World: 


purpose as habit mechanisms. 


this very intimate and biologically signifi- 
cant sense the organism may be said to 
know the world. No spiritual or super- 
natural forces need be assumed to un- 
derstand the acquisition of this knowl- 
edge. The process is entirely a naturalistic 
one throughout. 


II 


Once the organism has acquired within 
its body this subjective parallel to the 
ways of the physical world, certain other 
activity patterns or habit mechanisms at 
once become operative. One of the more 
important of these is the power of fore- 


FIG. 5. From Hull: Knowledge and 
purpose as habit mechanisms. 


The Organism: 
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sight or fore-knowledge. A great deal of 
mystery has surrounded this problem. 
Foresight may be defined for our present 
purpose as the reaction to an event which 
may be impending, but which has not as 
yet taken place. The difficulty seems 
largely to have been concerned with the 
problem of how an organism can react to 
an event not yet in existence. The rea- 
soning runs: An event not yet in exist- 
ence cannot be a stimulus; and how can 
an organism react to a stimulus which 
does not exist? In terms of our diagram, 
how can Rs, which is a reaction to the 
stimulating event Ss, take place before S; 
itself has occurred? 

An important circumstance connected 
with foresight is the fact that the tempo 
of the acquired subjective parallel to the 
outer world sequence is not limited to 
that of the latter. Indeed, there is evi- 
dence indicating a tendency for a primary 
conditioned reaction to run off at a higher 
speed than that of the master world se- 
quence which it parallels.? Thus it comes 
about that, even when both series begin 
at the same instant, the end-reaction of 
the subjective series may actually ante- 
date the stimulus in the world sequence 


2C, L. Hull, A functional interpretation 
of the conditioned reflex, Psychol. Rev., 
1929, 36, p. 507 ff. A quite distinct mech- 
anism serving much the same function as 
that here emphasized has its basis in the 
peculiar advantage afforded by distance re- 
ceptors. The stimulus of a distant object 
through a distance receptor is often suffi- 
ciently like that when the object is near 
and nocuous to evoke a successful defense 
reaction before the source of danger can get 
near enough to produce injury. This has 
been discussed in detail by Howard C. 
Warren, J. Phil., Psychol. & Scient. Meth., 
1916, 13, p. 35 f. 
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which exclusively evoked it previous to 
the conditioning shown in Fig. 4. It is evi- 
dent that this possibility of the height- 
ened tempo on the part of the organismic 
act sequence is intimately connected with 
the possession by the organism of knowl- 
edge of events before they actually take 
place. 

The biological advantage of antecedent 
knowledge of impending events is great. 
This is particularly clear in the case of 
defense reactions. These latter fall into 
two main types—flight and attack. Let us 
suppose that in the example elaborated 
above, Ss is a seriously nocuous stimulus 
and Rs is a successful flight reaction. 
Foresight will result from the reeling off 
of the R-series faster than the S-series so 
that s4 will evoke Rs before S; has oc- 
curred. In this event Ss, when it does oc- 
cur, will not impinge on the organism for 
the reason that the latter will have with- 
drawn from the zone of danger as the re- 
sult of the act Rs. In case Rs is an act of 
attack rather than flight it must, to be 
successful, bring the organismic series into 
contact with the world sequence in such 
a manner as to interrupt the latter before 
S; is reached. In this case also, the or- 
ganism clearly escapes the injury. Thus 
the supposed impossibility of an organ- 
ismic reaction to a situation before it ex- 
ists as a stimulus is accomplished quite 
naturally through the medium of an in- 
ternal substitute stimulus. 


m 


A reflective consideration of the habit 
mechanisms involved in anticipatory de- 
fense reactions reveals a phenomenon of 
the greatest significance. This is the ex- 
istence of acts whose sole function is to 
serve as stimuli for other acts. We shall 
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accordingly call them pure stimulus acts. 
Under normal conditions practically all 
acts become stimuli, but ordinarily the 
stimulus function is an incidental one. 
The consideration of the approach of an 
organism to food may clarify the con- 
cept. Each step taken in approaching the 
food serves in part as the stimulus for the 
next step, but its main function is to 
bring the body nearer the food. Such acts 
are, therefore, primarily instrumental. By 
way of contrast may be considered the 
anticipatory defense sequence presented 
above. Rs, the actual defense reaction, ob- 
viously has instrumental value in high 
degree. Ry, on the other hand, has no in- 
strumental value. This does not mean 
that it has no significance. Without R4 
there would be no sy, and without s4 
there would be no Rs i.e., no defense. In 
short, Ry is a pure stimulus act. In the 
same way R and Rə serve no instru- 
mental function but, nevertheless, are 
indispensable as stimulus acts in bring- 
ing about the successful defense response. 

A simple experiment which can be per- 
formed by anyone in a few moments may 
still further clarify the concept of the 
pure stimulus act. Ask almost any psycho- 
logically naive person how he buttons his 
coat with one hand—which finger, if any, 
he puts through the buttonhole, what the 
last act of the sequence is—and so on. 
The average person can tell little about it 
at first. If wearing a coat, he will usually 
perform the act forthwith. If warned 
against this, the hand may quite generally 
be observed to steal close to the position 
at which the buttoning is usually per- 
formed and to go through the buttoning 
behavior sequence by itself. After this the 
nature of the final buttoning act may be 
stated with some assurance. Clearly, the 
earlier acts of this pseudo-buttoning se- 
quence are pure stimulus acts since they 


serve no function whatever, except as 
stimuli to evoke succeeding movements 
and ultimately, the critical final move- 
ment which is sought. 

It is evident upon a little reflection that 
the advent of the pure stimulus act into 
biological economy marks a great advance, 
It makes available at once a new and en- 
larged range of behavior possibilities. The 
organism is no longer a passive reactor to 
stimuli from without, but becomes rela- 
tively free and dynamic. There is a tran- 
scendence of the limitations of habit as 
ordinarily understood, in that the or- 
ganism can react to the not-here as well 
as the not-now. In the terminology of the 
Gestalt psychologists, the appearance of 
the pure stimulus act among habit phe- 
nomena marks a great increase in the or- 
ganism’s “degrees of freedom.” The pure 
stimulus act thus emerges as an organic, 
physiological—strictly internal and indi- 
vidual—symbolism. Quite commonplace 
instrumental acts, by a natural reduction 
process, appear transformed into a kind 
of thought—rudimentary it is true, but of 
the most profound biological significance. 

Thus the transformation of mere ac- 
tion into thought, which has seemed to 
some as conceivable only through a kind 
of miracle, appears to be a wholly nat- 
uralistic process and one of no great sub- 
tlety. Indeed, its obviousness is such as 
to challenge the attempt at synthetic 
verification from inorganic materials. It is 
altogether probable that a “psychic” ma- 
chine, with ample provision in its design 
for the evolution of pure stimulus acts, 
could attain a degree of freedom, spon- 
taneity, and power to dominate its envir- 
onment, inconceivable alike to individ- 
uals unfamiliar with the possibilities of 
automatic mechanisms and to the profes- 
sional designers of the ordinary rigid-type 
machines. .. . 
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15. 
Mediated Generalization and the Interpretation 
of Verbal Behavior: I. Prolegomena*’ 


Charles N. Cofer and 
John P. Foley, Jr? 


Since Watson’s epoch-making hypoth- 
esis relating thinking to sub-vocal speech, 
psychologists have emphasized, to a 
greater or lesser degree, the important 
rôle which language mechanisms (verbal, 
manual, postural, etc.) play in complex 
human behavior. Although there has been 
much speculation regarding the nature 
and function of linguistic behavior, tela- 
tively few experimental data are available 
as the basis for systematized theory in 
this area. In fact, language mechanisms 
have often been regarded as “uncontrolled 
variables” in psychological investigations. 

The present paper reports an attempt 
(1) to extend the objective principles 


* From C. N. Cofer and J. P. Foley, Medi- 
ated generalization and the interpretation 
of verbal behavior: I. Prolegomena, Psy- 
chol. Rev., 49, 513-540 (1942). Re- 
printed by permission of the authors and 
the American Psychological Association. 

1The present paper represents the 
theoretical background for research being 
conducted by the writers under a grant- 
in-aid from the American Association for 
the Advancement of Science. 


derived from conditioned response ex- 
perimentation to certain aspects of lin- 
guistic behavior, and (2) to show how 
such an interpretation of language be- 
havior throws light on other psychological 
phenomena in which language plays an 
important rôle. It should be emphasized 
at the outset that not only are the condi- 
tioned response principles (eg, rein- 
forcement, generalization) here employed 
well established and generally accepted, 
but their validity as principles of linguistic 
behavior has been determined by direct 
experimentation, as will be noted from 
the survey of related experiments below, 
although the implications of such experi- 
ments for psychological theory do not 
appear to have been fully recognized. 
Language is here regarded as a form of 
conditioned behavior—both on the part 
of the speaker and on the part of the 
person spoken to. This objective psycho- 
logical approach to language behavior 
differs considerably from the philological 


2 The writers wish to express their ap- 
preciation to the following persons who 
read and criticized a preliminary copy of 
the present paper: Professor C. H. Gra- 
ham, Professor E. R. Guthrie, Professor 
C. L. Hull, Professor J. McV. Hunt, Pro- 
fessor W. S. Hunter, Dr. Margaret Keller, 
Dr. F. A. Mote, Professor Harold Schlos- 
berg. 
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and related approaches in which the 
major interest is in language morphology, 
i.e., language as things—isolated words or 
syllables. It also differs fundamentally 
from the logical discipline of semiotics 
(cf. Morris, 16), which is concerned with 
the systematic elaboration of the meta- 
language in terms of which all sign situa- 
tions may be classified and discussed. And 
it should be further emphasized that the 
study of language-as-conditioned behavior 
has no traffic with mentalistic theories 
which regard language as a means of “ex- 
pressing ideas.” For a comparison of these 
different approaches to language as well 
as for an objective psychological treat- 
ment of grammar, the reader is referred 
to Kantor (8). 


I. Experimental Background 
and Operational Analysis 


In the following paragraphs, we shall 
begin with a brief consideration of the 
phenomenon of generalization, followed 
by a discussion of the distinction between 
mediated and non-mediated (physical) 
generalization. Attention will then be di- 
rected to the problem of mediated verbal 
generalization,® after which the experi- 
ments in this field will be classified and 
the more relevant ones briefly summar- 
ized. The present section will conclude 
with a theoretical analysis of mediated 
generalization as a specific conditioned 
response phenomenon. 


8 We recognize the possibility of lin- 
guistic mediated generalization gradients of 
a non-verbal nature, as in the case of sign 
and gesture languages. Mediated generaliza- 
tion in some form undoubtedly occurs in 
such instances, and it would be interesting 
to study the generalization gradients in 
these language systems. 


The phenomenon of generalization or 
irradiation of conditioned responses re- 
fers to the empirically determined fact 
that if a conditioned response is estab- 
lished to a given stimulus (S,), other 
stimuli (S._,) of the same dimension 
will elicit the response without reinforce- 
ment, the magnitude of the generalized 
response varying inversely with the dis- 
tance of S2—n from S, along the given di- 
mension.* Such stimulus equivalence or 
gradients of generalization have been ex- 
perimentally demonstrated in the case of 
various stimulus dimensions, such as the 
pitch or loudness of tones, as determined 
by psychophysical experiments, and the 
spatial distance of tactual stimuli applied 
to the body surface. 

Several investigators have recently 
shown that generalization occurs along a 
semantic gradient, although the mech- 
anisms involved need to be clarified and 
extended by theoretical implication. If 
we omit all other experiments in which 
conditioned responses have been formed 
to verbal stimuli® and consider only those 
directly concerned with semantic general- 


4 We are not concerned here with the 
phenomenon of response equivalence, or 
response generalization. 

5 Noteworthy among such studies have 
been those on the conditioned acquisition 
of voluntary control of previously involun- 
tary responses, as well as those on the 
effect of positive and negative attitudinal 
factors on conditioning. Although both of 
these areas of investigation are relevant to 
the present problem of semantic generaliza- 
tion, no attempt will be made to consider 
them here. Similarly, the experiments on 
indirect or mediated conditioning (Shipley, 
N. E. Miller, Lumsdaine) are arbitrarily 
omitted from the present discussion, owing 
to the fact that the mediated generalization 
is not semantic in character. 


ization, we may classify the investigations 
into three major categories.° The first of 
these comprises experiments in which a 
conditioned reaction has been established 
to a stimulus object (denotatum) and 
generalization obtained to its name 
(sign). Positive results of this type have 
been reported by Kapustnik (9), Keller 
(10), Kotliarevsky (11, 12), Nevsky and 
Levin (17), Razran (19), Smolenskaya 
(27), Traugott (29), and Traugott and 
Fadeyeva (30). Conversely, Kapustnik 
(9), and Shastin (25), have described ex- 
periments in which conditioned reactions 
have been established to a word (sign) 
and generalization obtained to its object 
(denotatum). A third type of experiment 
has been concerned with the establish- 
ment of a conditioned reaction to one 
word (sign) and generalization to other 
semantically and phonetically related 
words (signs). Experiments by Diven 
(3), Keller (10), Razran (20, 21, 22), 
Riess (23, 24), and Wylie (32) are con- 
cerned with this problem. Since they are 
most relevant to the present paper, these 
experiments may be briefly described. 
Razran (20) measured the amount of 
saliva secreted while he thought of “sa- 
liva” in English, Russian, German, 
French, Spanish, and Polish. As controls 


®In his description of methods for 
studying conditioned reflexes in man, 
Ivanov-Smolensky (7) includes a discus- 
sion of verbal conditioning, but neither the 
original monograph nor a complete abstract 
was available to the writers. References to 
two other volumes edited by Ivanov- 
Smolensky, and presumably including a 
summary of experiments on verbal condi- 
tioning and semantic generalization per- 
formed by students in his laboratory, are 
cited by Razran (21, p. 90, footnotes 1 
and 2). 
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he used the Gaelic word for saliva, with 
which he was unfamiliar, a pair of non- 
sense syllables, and a period of “blank 
consciousness.” A quantitative index of 
his familiarity with these languages was 
obtained through his speeds of reading 
and of association in each. The results 
indicated that the largest amount of sa- 
liva? was secreted for the Russian word, 
the language of his childhood and adoles- 
cence, in spite of the fact that he is now 
more fluent in English. The German, 
French, Spanish, Gaelic, and Polish words 
yielded decreasing amounts of saliva in 
this order, which was the order of his 
familiarity with the languages, except for 
a reversal between Gaelic and Polish. 
Thus the degree of generalization ap- 
peared to vary as a function of his knowl- 
edge of or frequency of use of the spe- 
cific languages, although the results, ob- 
tained on a single subject, are tentative. 
A quantitative study of semantic con- 
ditioning in three adult human subjects 
is elsewhere reported by Razran (21). 
An attempt was made to separate the 
semantic or meaning-content factor from 
the phonetic or visual-auditory form of 
the word by the use of synonyms and 
homophones, Four stimulus words (style, 
urn, freeze, surf) were flashed on a screen 
while the subjects were eating, the 
amount of salivation to each of the 
stimulus words and subsequently to each 
of the homophones (stile, earn, frieze, 
serf) and synonyms (fashion, vase, chill, 
wave) being tested.’ The mean general- 


7 Measured by means of Razran’s ‘cotton 
technique,’ which consists in ascertaining 
the increment in weight of an absorbent 
dental cotton roll inserted under the sub- 
ject’s tongue for a period of one minute. 

8 Ibid. 
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ization was 59 per cent to the synonyms 
and 37 per cent to the homophones, thus 
indicating that the verbal conditioning 
was largely semantic. 

Riess (23) has repeated Razran’s experi- 
ment, using the same stimulus and test 
words but employing the galvanic skin re- 
action (GSR) to a loud buzzer as a sub- 
stitute for the salivary technique. The 
number of subjects varied from 4 to 9 in 
the case of the four stimulus words. Riess 
also found generalization to be greater to 
the synonyms than to the homophones, 
the mean percentage gain from condition- 
ing being 94.5 for the homophones and 
141.0 for the synonyms. In a recent un- 
published study Riess (24) has included 
antonyms and has studied generalization 
at different age levels. Results appear to 
indicate that in young children general- 
ization is greater to the homophones 
than to the synonyms, with the antonyms 
intermediate between the two, thus sug- 
gesting the relatively greater importance 
of phonetic as compared with semantic 
factors in the behavior of young children. 
With adults, however, the relationship is 
reversed, the order of increasing amount 
of generalization being: homophones, an- 
tonyms, synonyms. 

Wylie (32) repeated the experiment 
performed by Razran and Riess, condi- 
tioning the GSR (elicited by shock) to 
certain words and testing generalization 
not only to homophones and synonyms 
of these words but also to other words 
(controls) bearing no relationship to the 
conditioned words. She found evidence of 
greater generalization to the homophones 
and to the synonyms than to the control 
words, but her results indicated greater 
generalization to the homophones than 
to the synonyms. This variation from the 
findings of Razran and Riess may, per- 
haps, result from the fact that her sub- 


jects said they expected shock on the 
words that sounded like the conditioned 
words but not on the synonyms of those 
words. Had her subjects been misled as 
to the nature of the experiment, this re- 
sult might not have occurred. Wylie 
further studied semantic generalization 
by using nonsense syllables. Her subjects 
learned several pairs of syllables by the 
paired associates method, and the first 
members of two of these pairs were then 
conditioned. Generalization was found 
to be much greater to the syllables asso- 
ciated with the conditioned syllables than 
to those syllables associated with non- 
conditioned syllables. 

Another experiment by Razran (22) 
followed the same general method as that 
described three paragraphs above. For 
single-word conditioning, semantic factors 
were again found to be the most im- 
portant determiners of the amount of 
salivary generalization in the adult sub- 
ject, although “phonetographic”’ relation- 
ships (sound-spelling, e.g, dark, mark) 
were also very significant, especially at 
the beginning of the conditioning and 
after long continued pairings. Syntactic 
generalization was also studied by condi- 
tioning a salivary reaction to a 3-word 
sentence (consisting of subject, copula, 
and predicate) and then testing for gen- 
eralization to other 3-word sentences in 
which one or more of the three words 
was reversed—giving rise to 7 verbal varia- 
tions and to 4 contradictory and 3 con- 
cordant statements (e.g., Poverty is de- 
grading: Wealth is degrading, Poverty is 
not degrading, Poverty is not uplifting, 
Wealth is uplifting, etc.). Results in- 
dicated that the amount of generalization 
obtained depended upon the following 
factors (in decreasing order of strength of 
generalization): general agreement of 
statement, agreement of copula, predicate, 


subject, but reversals of copulas inter- 
fered more with transfer than general 
reversals of statements. Razran also re- 
ported that conditioned single words lost 
some of their generalization-strengths 
when combined in sentences, and that 
subjects’ opinions regarding the truth of 
the statement influenced the conditioning 
as well as the generalization value of the 
sentence, 

In a study designed to investigate the 
conditioning of anxiety reactions (GSR) 
to words, Diven (3) found generalization 
spreading “by meaningful relation” to 
other words in the series. For example, 
from the reinforced word bam, generaliza- 
tion occurred to other words in a “rural” 
category. 

In a somewhat different experiment, 
still in its preliminary stages, Keller (10) 
has found that when the GSR is condi- 
tioned to the picture of an object, there 
is generalization to the name of the ob- 
ject. She has also shown that a condi- 
tioned response established to one picture 
of an object (e.g., a hat) will be gen- 
eralized to the picture of another object 
in the same category (e.g., another hat). 
In part, this last result might be attributed 
to physical similarity of the pictures of 
the objects, but there may also be a 
factor of conceptual identity in the dif- 
ferent pictures which is in part respon- 
sible for the generalization. 

Let us now turn to a consideration of 
mediated as compared with non-mediated 
generalization. It will be noted that the 
dimension along which generalization 
occurs in the experiments described above 
is not a dimension characteristic of the 
physical attributes of the stimuli. The 
classical formulation of generalization 
principles presupposes naive organisms 
(cf. Hull, 5), whereas mediated (e.g., se- 
mantic) generalization depends upon 
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previously conditioned (usually language) 
behavior. Razran (19, pp. 70-71) implies 
this distinction in his “polymodal con- 
cept” of human conditioning, according to 
which the mean amount of conditioning 
is held to be a function of (1) a physio- 
logical factor dependent upon the ‘bio- 
logical potency’ of the stimulus and its 
correlated ‘physiological reaction-change’ 
and (2) a psychological factor resulting 
from the associational history and pattern- 
ing of the stimulus. A similar distinction 
has been made by Hull (6) in a discus- 
sion of the problem of stimulus equiva- 
lence in behavior theory.® Hull suggests 
that the three mechanisms mediating 
stimulus equivalence are: (1) the partial 
physical identity of the stimulus com- 
pounds, (2) primary or physiological gen- 
eralization (irradiation), and (3) second- 
ary or indirect generalization through the 
arousal of a reaction previously condi- 
tioned to the same stimulus continuum. 
Hilgard and Marquis (4, p. 201, italics 
ours) summarize the problem of general- 
ization and the definition of stimulus 
similarity as follows: 


There are a number of types of equiva- 
lence between stimuli (and the responses 
which they evoke) which cause the stimuli 
to be reacted to as similar, so that condi- 
tioned responses formed to one of the stim- 
uli will be generalized to the other. Among 
these may be mentioned: partial identity 
(whereby stimulus A-B is similar to A-C); 
sensory similarity (so that two colors are 
more alike than a color and a tone); formal 
similarity (for example, two patterns of 
ascending pitch); affective similarity (equiv- 
alence mediated by emotionally flavored 
processes, as in the “dark brown taste” or 
“blue Monday”; and mediated similarity 


9 Many of these distinctions bear a re- 
semblance to Kantor’s interbehavioristic 
“stimulus function.” 
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(as in the equivalence of words of different 
sounds, but of common meanings). Of these 
relationships, only the first (partial identity) 
may be conceived of as physical similarity. 
The second (sensory similarity) may be 
mediated by relatively primitive physiologi- 
cal processes, as represented in the classical 
experiments on generalization within a sen- 
sory modality. The others all depend upon 
telatively complex processes, many of which 
require previous learning in order that the 
stimuli involved may be responded to as 
similar. 


It is with this final type of “mediated” 
generalization that we are here concerned. 
It is clear that semantic generalization 
would not take place in the case of a 
subject who did not know the meaning 
of the words or who saw no conceptual 
identity or similarity in the pictures of 
the hats in Keller’s experiment. The medi- 
ated or semantic generalization in such 
experiments thus presupposes and de- 
pends upon the pre-experimental forma- 
tion of conditioned responses or associa- 
tions, i.e., the gradient of generalization 
is a gradient along a dimension of con- 
ditioned stimulus functions. The stimuli 
need be similar only in so far as they 
have been previously conditioned to the 
same (or similar) response. 

A simplified schema of such mediated 
or semantic generalization is suggested in 
Fig. 1. At some pre-experimental time, 
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the subject has become conditioned, 
either by direct reinforcement or by 
higher order conditioning, to make R, to 
CS7 OSs; CSi 42 CSL The subject is 
next experimentally conditioned by rein- 
forcing CS, with UCS,, setting up a con- 
ditioned response, R,. Generalization is 
now found to CS, . . . CS,, the magni- 
tude of the generalized response presum- 
ably depending upon the relative strengths 
of the pre-experimental conditioning of 
GSi fat CSy"tor Re 

It should be emphasized that the 
schema in Fig. 1 is an operational account 
of what descriptively occurs in mediated 
generalization. Hypotheses regarding 
further, non-observable mechanisms could 
be introduced with reference to the man- 
ner in which generalization may be said 
to occur along the previously-conditioned 
stimulus-response continuum. Thus one 
might assume, following the theoretical 
analysis of Guthrie, Hull, and others, 
that upon the pre-experimental condition- 
ing of CS, . . . CS, to Ra, each of these 
stimuli is also conditioned to an implicit, 
fractional, kinesthetic re which invar- 


FIG. 1. Simplified descriptive schema for 
the development of mediated generaliza- 
tion. From Cofer and Foley: Mediated 
generalization and the interpretation of 
verbal behavior: I. Prolegomena. 
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iably occurs with each pre-experimental 
reinforcement of R,. In the later, experi- 
mental situation, CS, is conditioned to 
R,. But during each reinforcement of this 
conditioning, CS, evokes r+, the proprio- 
ceptive stimulation (s,) from which also 
becomes conditioned to Ry. Now, when 
CS, . . . CS, is presented alone for test- 


10 Evidence concerning the role of such 
mediating responses is found in a series of 
different experiments by Miller (13, 14), 
designed to test the influence of past ex- 
perience upon the transfer of subsequent 
training. Although both rodent and human 
subjects were used in different experiments, 
our present interest is in the verbal be- 
havior of the latter. One such experiment 
made use of numbers and letters as differ- 
ent material categories pre-experimentally 
acquired and inter-associated by the sub- 
jects. A conditioned GSR differentiating 
between a specific number and a specific 
letter was set up, and differential general- 
ization was found to other numbers and 
letters which had not been subject to di- 
rect reinforcement (cf. 13, p. 70). In 
further series of experiments, “controlled 
patterns of association were established 
through the learning of nonsense syllables. 
Possible effects of original similarities be- 
tween pairs of syilables were eliminated by 
the systematic use of the same syllables in 
different patterns of association for differ- 
ent subjects. Differential conditioned gal- 
vanic reactions were established to a pair 
of stimuli by shock and non-shock combi- 
nations after which the previous associates 
of the shock and non-shock pair were pre- 
sented without shock. Photographic rec- 
ords of the responses showed contrasting 
reactions to the syllables associated to the 
shock and non-shock elements of the 
primary conditioning pair” (13, “Digest” 
inserted in front of “Table of Contents”). 

“Additional experiments on human sub- 
jects demonstrated that (a) galvanic 
reactions may be conditioned to the stimuli 
involved in the subject’s own verbal re- 
sponses; (b) conditioned reactions of this 
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ing mediated generalization, it will evoke 
tz, whose Ss will in turn elicit R,.!° Thus, 
from a purely molar or descriptive point 
of view, S ... Sa will lead directly to 
R,. A diagrammatic representation and 
more detailed discussion of these inferred 
mechanisms are presented by Hull (6, pp. 
27-28). 


type are subject to experimental extinc- 
tion; (c) under certain circumstances, the 
functional activity of the verbal response 
previously associated with both members of 
a pair of stimuli may be essential to the 
subsequent transfer of conditioning from 
one of these stimuli to the other; and 
(d) under certain circumstances this cru- 
cial role of the mediating verbal response 
may be demonstrated—with dynamically 
opposite effects—for the transfer of either 
the positive or the negative aspects of a 
differential conditioned galvanic response” 
(13, p. 70). Miller thus concludes that the 
evidence (from both human and rodent 
subjects) in his series of experiments 
“demonstrates the influence of previous as- 
sociations upon the generalization of sub- 
sequent conditioning and indicates that 
mediating responses can play an important 
role in this transfer” (13, “Digest” ). 

Miller and Dollard (15, p. 77) report 
an unpublished dissertation by Birge (1) 
in which behavioral generalization in chil- 
dren was found to be mediated by verbal 
responses. Birge found that “if young 
children are taught to call two very differ- 
ent stimulus objects by the same name, 
other responses (such as reaching for the 
objects) are more likely to generalize from 
one to the other than when the two ob- 
jects have been given different names.” 
Birge likewise noted that “such generaliza- 
tion is much more likely to occur when 
the children say the name aloud, so that it 
is certain that the cue-producing response 
is actually present, than when they do not 
say the name aloud” (15, p. 77). Miller 
and Dollard (15, pp. 74-78) also discuss 
the rôle of the mechanism of mediated 
generalization in various forms of adult 
social behavior. 
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II. Formal Illustration, Methods 
of Experimental Demonstration, 
and Implications for Behavior Theory 


In this section an attempt will be made 
to extend the previous analysis and to 
illustrate its application to various psy- 
chological situations. More specifically, 
the section will begin with the discussion 
of a formal system of notation for desig- 
nating mediated (i.e., synonym) and non- 
mediated (i.e homophone) generaliza- 
tion gradients, after which the discussed 
synonym and homophone relationships 
will be illustrated by application to an 
hypothetical subject. A number of other 
gradients (other than synonym and 
homophone) along which mediated gen- 
eralization might be expected to occur 
will next be suggested. A minimum num- 
ber of formal concepts essential to the 
present theory will then be presented, 
followed by a discussion of methods for 
experimental check or demonstration of 
the expected relationships in the case of 
a given subject... . 

The implications of semantic general- 
ization for behavior theory, especially 
when combined with non-semantic or 
physical (e.g., phonetic) generalization, 
appear not to have been adequately rec- 
ognized. The relationships explicated in 
Fig. 1 may be regarded as a generalized 
statement of the nature of mediated 
stimulus equivalence. We are here inter- 
ested in one form of mediated generaliza- 
tion, viz., that involved in verbal lan- 
guage behavior; we are also concerned 
with non-mediated generalization insofar 
as it plays a part in these problems. 

In Fig. 2 we have suggested certain 
formal relationships which might be ex- 
pected to obtain in the case of an or- 
ganism whose language behavior is highly 


developed. Mediated generalization is 
here depicted in terms of synonymity of 
words and non-mediated generalization 
in terms of homophonymity of words, 
The following set of definitions will ex- 
plain the system of notation used in this 
figure: 


P refers to the original, reinforced stim- 
ulus (presentation) word. 

S refers to a synonym of P. 

H refers to a homophone of P. 

N refers to a neutral word. 

Numbers in parentheses designate the 
number of semantic or phonetic 
transformations removed from P. 

S, refers to a synonym of the preceding 
synonym. 

S, refers to a synonym of the preceding 
homophone. 

H, refers to a homophone of the preced- 
ing synonym. 

(No notation is required for a homo- 
phone of a preceding homophone. 
Cf. below.) 

A prime (’), or primes (” or '”), is used 
to differentiate various words or vari- 
ous sets of words which are synonyms 
or homophones of the preceding 
word but not synonyms or homo- 
phones of each other. 

A long bar (——) is used to cover a set 
of words (synonyms) which are also 
synonyms of each other. It is ex- 
tremely unlikely that there will be a 
set of homophones which are syn- 
onyms of each other. 

It is evident that if two or more words 
are homophones of a preceding word 
they will be homophones of each 
other. It is extremely unlikely that 
there will be a set of synonyms which 
are homophones of each other. 


It will be noted that Fig. 2 is a formal 
representation of some of the possible 
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relationships arising from certain phonetic 
and semantic (mediated) generalization 
gradients. A given word, P, is presented 
and reinforced. According to the data of 
Diven (3), Razran (21, 22), Riess (23, 
24), and Wylie (32), synonomous words, 
when presented, will likewise elicit a re- 
sponse, though less in degree. Now P may 
have only one synonym or it may alsg 
have several synonyms; in the latter case 
these several synonyms may not bear to 
P the same degree of semantic relation- 
ship, ie., one word (synonym) may be 
more completely interchangeable with P 
than the others although all must bear 
some degree of interchangeability with P. 
(In this connection it should be noted 
that language authorities seldom assert 
that two words have precisely the same 
meaning. It seems likely, therefore, that 
the foregoing statement is sound.)™ 
Therefore, we may have a series of words, 
varying in semantic similarity to P, which 
would be likely to elicit different degrees 
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FIG. 2. Formal illustration of certain 
phonetic and semantic (mediated) gener- 
alization gradients in hypothetical subject. 
From Cofer and Foley: Mediated gener- 
alization and the interpretation of verbal 
behavior: I. Prolegomena. 

* For experimental purposes it is neces- 
sary to have a neutral (control) word, 
N, at every stage in the diagram; a set 
of such neutral words bearing the relation- 
ship of synonymity or homophonity to 
each other could also be utilized as addi- 
tional controls. 


11 It is necessary to remember that the 
relation of synonymity in the language be- 
havior of persons is dependent upon previ- 
ous associations (conditioning). Hence, we 
cannot expect generalization gradients to 
picture the dictionary semantic relation- 
ships but should expect them to vary with 
the particular individual in the light of his 
language history. Cf., e.g, Mosier, C. I., 
A psychometric study of meaning. Psychol. 
Bull., 1939, 36, 607-608, and J. soc. Psy- 
chol., 1941, 13, 123-140. 
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of response as a function of the degree of 
their similarity to P.12 

Furthermore, P may have more than 
one meaning; e.g., the word vain has both 
the meaning of conceited and of fruitless. 
Hence, it is possible to conceive the rein- 
forcement of P as causing generalization 
effects along more than one semantic 
series, 

Another possibility for generalization 
from the reinforced word (P) is provided 
by the homophone relationship.** For ex- 
ample, if vain is the reinforced word, the 
effects of this reinforcement may spread 
to vein and to vane. We cannot be cer- 
tain that these words would elicit dif- 
ferent amounts of response to form a 
definite gradient, but such factors as rela- 
tive familiarity of the homophones (cf. 
Razran, 20) and degree of similarity in 
spelling might cause a definite gradient to 
appear.* At any rate, we are probably 


12 Ibid. 

18 There are many possibilities here. In 
the text we are chiefly concerned with 
words, conventionally designated as homo- 
nyms or homophones, which are alike in 
sound but not in spelling and meaning. 
Homographs could also be considered, 
both when the words have the same sound 
and spelling but different meanings (e.g., 
fair, beautiful and fair, market) and when 
the words are spelled alike but differ in 
both sound and meaning (e.g., bow, knot 
and bow, forward part of a vessel). Like- 
wise, we have said nothing concerning the 
place of the antonym in this picture. Gen- 
eralization along each of these (and other) 
continua could readily be investigated. 

14 It should also be noted that partial 
identity in sound or spelling might be ade- 
quate for some generalization to appear. 
For example, if lamp be the reinforced 
word, generalization might appear to such 
words as tramp, cramp, camp, etc. Cf. 
Razran (22). 


justified in assuming that generalization 
would occur to homophones, whatever 
the type of curve. 

Deriving from the foregoing generaliza- 
tion gradients are several other possibil- 
ities: 

1, From each of the synonyms of the 
original word there will be possible homo- 
phone gradients. Also, in the event that 
any of these synonyms has more than 
one distinct meaning, there will be in 
addition gradients formed by the syn- 
onyms arising from the different mean- 
ing, as well as homophone gradients aris- 
ing from each of the members of the new 
synonym series, 

2. Each of the homophones arising 
from the synonyms described above in 1 
also may have synonyms, causing addi- 
tional synonym gradients to appear; these 
synonyms may have homophones, more 
than one meaning, etc. The number of 
possible gradients is thus extended to a 
very large number. 

3. Each of the members of the series 
of words homophonous with respect to P 
may have synonyms,—several sets of syn- 
onyms in the cases of words having more 
than one meaning. Each of these syn- 
onyms may have homophones, and so 
OLN eet 
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16. 
Mediated Verbal Similarity as a Determinant 
of the Generalization of a Conditioned GSR*’ 


Laura W. Phillips 


The generalization or “spread” of CR’s 
to stimuli on the same dimension as the 
CS has been studied extensively. With 
human Ss, generalization along such di- 
mensions as tonal frequency (7), tonal 
intensity (8), and spatial distances along 


* From L. W, Phillips, Mediated verbal 
similarity as a determinant of the generali- 
zation of a conditioned GSR, J. exp. Psy- 
chol., 55, 56-62 (1958). Reprinted by 
permission of the author and the American 
Psychological Association. 


the skin (1) has been investigated. Gen- 
eralization of the salivary CR along verbal 
dimensions has been explored by Razran 
(12), and the same verbal dimensions 
were employed in a study by Riess (13), 
using the conditioned galvanic skin re- 


1 This research represents a major por- 
tion of a thesis submitted in partial fulfil- 
ment of the requirements for the degree of 
Master of Arts in the Department of Psy- 
chology of the University of California in 
1953. The writer wishes to express her 
appreciation to Professors Leo J. Postman 
and Edwin E. Ghiseli for guidance and 
advice in this research, and to Professor 
Mark R. Rosenzweig for technical assist- 
ance in the use of the Garceau Clinical 
Dermohmeter and in evaluation of the 
readings. 


sponse (GSR). Both investigators found 
that the CR generalized to meaningful 
synonyms, €g, from “urn” to “vase,” 
more than to phonetographically similar 
words such as from “urn” to “earn.” 

Cofer and Foley have applied Hull’s 
principles of primary and secondary gen- 
eralization in an analysis of language be- 
havior (2). They have demonstrated 
homophone, synonym, and antonym gen- 
eralization by preliminary training with 
lists of words related to a test list along 
these dimensions (3, 4). However, the 
scaling of verbal similarity employed by 
these investigators suffers from methodo- 
logical difficulties. First, it is difficult to 
isolate a single verbal dimension. For ex- 
ample, a given synonym dimension is 
likely to be confounded with other syno- 
nym dimensions as well as with various 
homophone, pseudo-homophone and 
antonym dimensions, to mention only a 
few possibilities (2, 3, 4). This method of 
scaling encounters further problems in 
connection with the determination of 
equal scale intervals. 

To overcome these difficulties, it seems 
necessary to choose verbal stimuli which 
are initially devoid of meaning and to in- 
duce varying degrees of similarity among 
them under controlled conditions of asso- 
ciative learning. The degree of similarity 
can then be defined and measured with 
reference to the conditions of preliminary 
training. 

The purpose of the present study was 
to investigate the generalization of a CR 
along an experimentally produced dimen- 
sion of verbal similarity. The method 
chosen for producing varying degrees of 
similarity among a series of verbal stimuli 
was that of establishing associative con- 
nections between nonsense words and 
points along a well-established sensory di- 
mension (in this case, brightness). When 
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associations between members of a series 
of verbal stimuli and members of a series 
of brightness stimuli have been estab- 
lished, it is assumed that an associative 
relationship will exist among the words 
themselves, mediated by the associations 
between the words and different positions 
along the sensory scale. Such a mediated 
similarity scale would be manifest by Ss’ 
subsequent responses under relevant test 
conditions. 

The experiment attempted to answer 
two questions: (a) Can a scale of medi- 
ated verbal similarity be established? (b) 
What is the nature of the generalization 
gradient as a function of such a similarity 
scale? 


Method 
MATERIALS 


The stimuli used were: (a) five seven- 
letter Turkish words (14) typed on 5-in. 
by 3-in. cards and presented in random 
orders; (b) five Munsell grays of the 
values N1/, N3/, N5/, N7/, and N9/ re- 
spectively from dark to light (10)? The 
five values chosen constituted a series of 
equal sense distances, 100 JND’s separat- 
ing successive scale positions. Three sets 
of the five grays were cut into 1% in. 
circles and mounted on 6-in. by 18-in. 
white cards. The values of the grays were 
ordered differently on each of the white 
cards according to a restricted randomiza- 
tion, i.e., they never appeared in the order 
of their scale values. These three displays 


2 The author wishes to express apprecia- 
tion to Professor Gordon L. Walls of the 
Optometry Department of the University 
of California for his expert advice in choos- 
ing the values of the Munsell grays and for 
preparing the color circles used in the ex- 
periment. 


Communication 


166 


made it possible to vary the spatial posi- 
tions of the different grays from trial to 
trial. 

For purposes of experimental training, 
each of the Turkish words was paired with 
one of the gray circles. The particular 
word-color combinations were varied 
from S to S. Five different sets of paired 
associates were used in rotation. 


PROCEDURE 


The experimental period was divided 
into three parts: a training session de- 
voted to establishing associative connec- 
tions between the words and the points 
on the brightness dimension; a condi- 
tioning session in which one of the words 
was used as a CS and the other words 
were used in tests for generalization; and, 
finally, a short association test based on 
the previously learned words. 

Training session—The Ss were in- 
structed to learn the paired associates as 
a memory task, and to pronounce the 
words as though they were English. The 
training procedure began with an initial 
presentation of the paired stimuli in the 
following manner: E showed each word 
card to S once and pointed to the gray 
circle paired with it while S pronounced 
the word. Paired-associate training trials 
were then carried out as follows: (a) E 
pointed to a circle while S was required 
to pronounce the word which had been 
previously presented with that color; (b) 
a word card was shown to S, he pro- 
nounced the word and was required to 
point simultaneously to the correct color 
circle. The five words or colors were used 
as stimuli or responses respectively in the 
above manner randomly within each trial 
in order to equalize the strengths of the 
associations in both directions, i.e., word- 


color, and color-word. A trial consisted of 
the presentation of the five pairs in the 
manner described under (a) and (b). 

A 3-sec. interval was allowed between 
the presentation of the words or colors 
and S’s response. If S did not respond 
within 3 sec., E gave the response by in- 
dication, i.e, by pointing to a color or 
showing a word card, and S repeated it 
by pronouncing the word and pointing 
to the color. The E confirmed or cor- 
rected each response by indication, and 
S repeated each correction. An interval of 
5 sec. elapsed between S’s response and 
the next stimulus presentation. A 10-sec. 
intertrial interval was allowed in order to 
change the color-display and word-card 
orders, 

The trials were continued until S 
learned to a criterion of three perfect 
recitations, After criterion was reached, S 
was given a 5-min. rest interval. Follow- 
ing the rest, training continued to the 
point of 100% overlearning (double the 
number of trials up to, but not including, 
the three criterial trials) in order to in- 
sure a high degree of association between 
the words and colors. 

Conditioning session —After comple- 
tion of the training session, a screen was 
placed on the table between S and E. The 
words were presented through a cut-out 
in the screen. A Garceau Clinical Der- 
mohmeter was used to measure the skin 
resistance. Electrodes were placed on the 
palms and held firmly in place with ad- 
hesive tape. The UCS was a pure tone of 
300 cps, at 80 db sensation level. This 
tone had been tested on S prior to the be- 
ginning of the training session in order to 
ascertain sensitivity of his GSR. The tone 
was sufficiently loud to elicit a GSR from 
all Ss. 

Pre-conditioning levels of GSR were 
determined for each S by presenting each 


of the previously-learned words twice in 
random orders. A plain, white card, of 
the same dimensions as those on which 
the words were presented, was also pre- 
sented without reinforcement at unequal 
intervals throughout all the conditioning 
and test trials in order to extinguish any 
response to the card as such. 

Twelve reinforced trials were given, in 
which the CS (the N1/ word, dark ex- 
treme of scale) was paired with the UCS. 
The interval between presentation of CS 
and UCS was 3 sec., and an interval of 
approximately 10 sec. intervened between 
presentations of the CS-UCS pair. (‘This 
interval varied around 10 sec, due to varia- 
tion in the time taken for the Dermohm- 
eter needle to return to a zero reading 
after deflection.) The CS was then pre- 
sented twice without the tone to test for 
conditioning, after which each of the 
other four words in the series was pre- 
sented twice in two different random or- 
ders to test for generalization. The test 
stimuli were presented at the same rate 
as the CS-UCS pair during conditioning. 

Association test—After the condition- 
ing session was completed and electrodes, 
earphones and screen removed, an asso- 
ciation test was given in order to get an 
independent test of the establishment of 
a similarity scale. Each of the words was 
shown to S for 2 sec, and he was in- 
structed to respond immediately with any 
other word from the training series which 
the given cue word suggested. 


SUBJECTS 


Twenty-one University of California 
freshmen served as Ss. They were all naive 
with respect to the purpose of the experi- 
ment, and none had any familiarity with 
the Turkish language. 
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PAIRED-ASSOCIATE LEARNING 


Mean trials to learn were computed on 
the basis of number of trials to and in- 
cluding the last trial on which an error 
was made. The three criterion trials were 
not counted as trials to learn. Mean trials 
to learn all words to the criterion of three 
perfect recitations was 13.02 (SD = 
7.17). There was a significant difference 
between words paired with different scale 
positions as indicated by an F of 11.57, 
P < .01. The smallest mean trials to learn 
were those yielded by words associated 
with N1/ and N9/. The Tukey gap test 
(15) was used to determine significant 
breaks between the means of trials to 
learn words paired with the different scale 
positions. The differences between the 
means of the words associated with the 
two colors representing the end positions 
of the brightness scale from those of the 
three middle positions was significant be- 
yond the .01 level. Hence, the easiest 
words to learn were those paired with 
either end of the brightness scale. This 
finding cannot be attributed to the rela- 
tive difficulty of the words per se, since 
they were rotated from S to S with re- 
spect to their color associates. 


CONDITIONING 


The scores used in this analysis were 
obtained from the Dermohmeter read- 
ings in the following way: immediately 
prior to the exposure of S to a word (CS 
and test words alike) the resistance level 
of S was recorded in ohms. The stimulus 
was then presented, and S’s GSR was 
measured in terms of the peak deflection 
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from the initial resistance level. In ac- 
cordance with the findings of Haggard 
(6) on selection of appropriate GSR 
measures for use in analysis of variance 
tests, log conductance changes were com- 
puted for each response. 


TABLE 1 


Analysis of Post-Conditioning Increments 
in GSR’s (Log Conductance Changes) 


MEAN 
DIFFERENCE 
(OVER PRE- 

MEASURE COND. LEVEL) om P 
cs 1.24 12 <.001 
White card .23 rly) <.20 
CS minus white 

card 1.00 13 <.001 


From Phillips: Mediated verbal similarity as a 
determinant of the generalization of a condi- 
tioned GSR. 


Table 1 gives the analysis of mean dif- 
ferences between pre- and post-condition- 
ing levels of response to the CS word and 
to the neutral white card. The t of 9.97 
for the CS demonstrates that a highly 
significant degree of conditioning was es- 
tablished. The mean difference of .23 be- 
tween pre- and post-conditioning response 
levels to the white card does not reach 
significance. Hence, generalized GSR’s to 
a neutral stimulus associated with the CS 
which may have developed during condi- 
tioning were not present to a significant 
degree during the test for generalization. 
Finally, the mean difference of 1.00 be- 
tween the post-conditioning increments 
in GSR to CS and white card is signifi- 
cant beyond .01. From these findings it is 
concluded that the GSR was differen- 
tially elicited by the word used as CS, and 
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FIG. 1. Generalization of the response 
conditioned to the word previously asso- 
ciated with N1/. From Phillips: Mediated 
verbal similarity as a determinant of the 
generalization of a conditioned GSR. 


did not constitute a generalized response 
to the total experimental situation. 

The pre-conditioning GSR’s to the five 
words show no significant variation as a 
function of scale position, (F = 1.12). 
However, as shown in Fig. 1, a trend ap- 
pears in the generalized responses tested 
after conditioning of the word associated 
with N1/ (dark extreme of scale), Table 
2 gives the results of the analysis of vari- 
ance of differences between the pre-con- 
ditioning means and_post-conditioning 
means for the five stimulus positions. 

In order to analyze the shape of the 
generalization gradient plotted in Fig. 1, 
the method of orthogonal polynomials, 
described by Grant (5), was used. The 
over-all trend of the responses as a func- 
tion of the mediated-similarity scale was 
significant beyond the .01 level. The 
negative linear, and positive quadratic 
components are each significant beyond 
the .01 level. Hence, the shape of the 
gradient is concave upward. Since pə is 
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TABLE 2 
Trend Analysis of Post-Conditioning Increments 
in GSR’s (Log Conductance Changes) 


SOURCE df MS ERROR TERM F 
A. Overall trend 4 1,022 Cc 3,80* 
a. linear 1 1.492 Cc, 10,58* 
b. quadratic 1 2.534 Cp 8.92* 
c. cubic 1 004 Ce 
d. quartic 1 059 Cy 
B. Between individual means 20 1,957 Cc 
C. Between individual trends 80 .269 
a. linear 20 141 
b. quadratic 20 .284 
c. cubic 20 161 
d. quartic 20 483 
D. Total 104 
*P<.01. 


From Phillips: Mediated verbal similarity as a determinant of the generaliza- 


tion of a conditioned GSR. 


positive, the significance of the quadratic 
component is heavily weighted by the 
generalized response to the word associ- 
ated with the N9/ position. 


ASSOCIATION TEST 


If Ss were to give their associations by 
choosing at random from the four other 
Turkish words, the probabilities of an ad- 
jacent association corresponding to each 
of the brightness-scale positions are: N1/, 
V4; N3/, Ya; N5/, Yz; N7/, Yz; N9/, 1⁄4. 
The presentation of each of the five words 
to each S allows five opportunities per S 
for an adjacent association to occur, with 
probabilities as above. Hence, by chance, 
there should be an average of two ad- 
jacent associations per S. 

However, if a scale of similarity has 
been established among the words as a re- 
sult of the paired-associate training with 


the brightness dimension, one should ex- 
pect significantly more than chance ad- 
jacent associations. 

The mean of the obtained adjacent as- 
sociations was 2.52 (Om = .18). Since the 
frequency distribution of adjacent asso- 
ciations was reasonably symmetrical, a 
one-tail t test was used to test the hypoth- 
esis that the obtained mean was not 
greater than 2. Since t = 2.94, (P <.005), 
it is concluded that Ss responded to the 
cues with another word from an adjacent 
part of the scale significantly more than 
by chance. Hence, the association results 
indicate a similarity relationship among 
the five words selected from an unfamiliar 
language. 


DISCUSSION 


The results of this experiment have 
demonstrated: (a) the establishment of a 
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scale of mediated verbal similarity; and 
(b) that a CR generalizes over the major 
portion of such an experimentally-pro- 
duced dimension as a decreasing function 
of the differences from the CS. 

According to Hull (9, p. 184f), a 
sensory continuum, such as the bright- 
ness dimension used in this experiment, 
should generate an “afferent generaliza- 
tion continuum” during conditioning. 
Further, the generalized reaction poten- 
tial along a primary stimulus dimension 
should constitute a decreasing function 
of the distances from the CS. Hull’s anal- 
ysis of “secondary stimulus generaliza- 
tion” may be applied to the paired-asso- 
ciate training and subsequent condition- 
ing of Ss in this experiment. 

During the paired-associate training, 
when a Turkish word and a gray circle 
are presented to S, his response is a com- 
plex act; i.e., visual perception of several 
shades of gray, discrimination of the “cor- 
rect” shade, pronunciation of the word, 
and simultaneously pointing to the dis- 
criminated shade. (For the sake of sim- 
plicity of exposition, the color-word direc- 
tion of association will be omitted, but 
the same theoretical applications hold for 
both.) “Feed-back” stimuli then arise 
from this complex of overt and mediat- 
ing responses made by the S to the stim- 
uli on the primary sensory dimension. 
Hypothetically, such stimuli might func- 
tion as representational or symbolic cues 
to which responses can be conditioned, 
such as those which might be conceived 
to arise from the judgmental act of choos- 
ing the correct shade of gray to pair with 
a given word. 

One further assumption is needed: The 
hypothetical mediating responses made 
to any two neighboring points on the 
sensory scale are more similar than are 
those made to any two removed points. 


In more concrete terms, visual presenta- 
tion of the word associated with N1/ will 
elicit, together with its overt responses 
(pronunciation of the word, pointing to 
the color) several mediating responses, 
(e.g, “black,” “very dark,” etc.) Simi- 
larly, presentation of the words associated 
with N3/, N5/, N7/, and N9/, will elicit 
different overt and mediating responses. 
However, the mediating responses elicited 
by the N3/ word will be more similar to 
those elicited by the N1/ word than will 
those elicited by, say, the N5/ word. 

Osgood (11, p. 704) proposes such a 
“mechanism for degrees of similarity 
among mediation processes,” and cites 
the lack of this assumption as a serious 
flaw in the theoretical formulation of 
Cofer and Foley (2). Moreover, this as- 
sumption may be justified in the present 
experiment by the conditions of training; 
i.e, the sensory stimuli consisted of a pre- 
established differential series. 

Given these assumptions about what 
happens in the process of over-learning 
the paired associates during the training 
session, the results of the subsequent as- 
sociation test follow: The cue word will 
elicit mediating responses which are more 
similar to the mediating responses elicited 
by the word in the next scale position 
than to those of further removed words. 
These mediating responses will then pro- 
duce stimuli which have become associ- 
ated with the cue word; similar stimuli 
will have become associated with the 
next scale-position word and the result- 
ing generalization gradients will overlap 
at a high level of reaction potential, as 
formulated by Hull (9, p. 195). Hence, 
the most probable word to be used as a 
response to any given cue will be the one 
associated with the next sensory-scale po- 
sition. 

Finally, when S’s GSR is conditioned 


to a word (in this case, the one associated 
with NI/), the mediating responses to 
this word also become conditioned. Since 
the mediating processes of the other 
words are differentially similar to those 
of N1/, the conditioned GSR will gen- 
eralize to these words as a function of 
their similarity. The further removed the 
words are along the scale, the less similar 
to N1/ (the CS) will be their mediation 
processes, Hence on subsequent tests for 
generalization, the generalized GSR will 
be a decreasing function of the scale dis- 
tance from N1/. 

But how may we account for the rise 
in generalized GSR at the extreme oppo- 
site of the scale (see Fig. 1)? So far, the 
results of this experiment have paralleled 
Osgood’s formulation of semantic gen- 
eralization, according to which general- 
ized reaction to similar mediators will be 
facilitated and generalized reaction to op- 
posites will be inhibited (11, p. 708). 
However, he also presents evidence that 
responses to opposites (as frequently ob- 
served in free association tests) cannot be 
based upon semantic mediation processes, 
but are due to highly overlearned verbal 
habits (11, pp. 709-711). There is also 
evidence to support this view from the 
paired-associate training data of the pres- 
ent experiment, viz. the “anchoring ef- 
fect” at the two extremes of the scale ex- 
hibited in significantly lower mean trials 
to learn words paired with N1/ and N9/. 
Since these two grays were often referred 
to as “black” and “white” by Ss, it may 
well be that they utilized a strong “black- 
white” response habit to delineate the 
scale during the paired-associate training. 
It may be concluded, then, that the gen- 
eralized GSR received a “boost” at the 
end of the mediated scale by virtue of 
summation with an already stronger re- 
sponse at this point. 
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SUMMARY 


An experiment was designed to estab- 
lish a scale of verbal similarity and to test 
the generalization of a CR over this scale. 

Five Turkish words were paired with 
five neutral Munsell colors constituting 
a brightness scale. Twenty-one Ss were 
trained to associate words and colors to a 
criterion of 100% over-learning beyond 
three perfect recitations of the pairs. The 
Ss were then conditioned to the word 
which had previously been learned as a 
paired associate to the dark extreme of 
the brightness scale. For conditioning, a 
loud, pure tone was paired with the stim- 
ulus word, and GSR was measured. The 
CS word and the other words in the series 
were then tested for GSR without the 
tone. After conditioning the words were 
presented randomly and first associations 
were recorded. 

The results indicate that a mediated 
verbal similarity scale was established, and 
that the generalization gradient over the 
major part of this dimension was a de- 
creasing function of the distance of the 
test stimulus from the CS. 

These results were discussed in terms 
of (a) Hull’s principles of primary and 
secondary generalization, and (b) Os- 
good’s application of these principles to 
language behavior. 
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17. 
The Mediation Hypothesis* 


Charles E. Osgood 


* From C. E. Osgood, The mediation hy- 
pothesis, in Method and Theory in Experi- 
mental Psychology, New York: Oxford 
University Press, 1953, pp. 695-698. Re- 
printed by permission of the author and 
the Oxford University Press. 

1C. W. Morris. Signs, language, and 
behavior. New York: Prentice-Hall, 1946. 


. . . Whereas Morris! links sign and 
object through partial identity of object- 
produced and disposition-produced be- 
havior, we shall link sign and object 
through partial identity of the ‘disposi- 
tion’ itself with the behavior elicited by 
the object. Words represent things be- 
cause they produce some replica of the 
actual behavior toward these things. This 
is the crucial identification, the mecha- 
nism that ties signs to particular stimulus- 
objects and not to others. Stating the 


proposition formally, we may say: a pat- 
tern of stimulation which is not the ob- 
ject is a sign of the object if it evokes in 
an organism a mediating reaction, this (a) 
being some fractional part of the total 
behavior elicited by the object and (b) 
producing distinctive self-stimulation that 
mediates responses which would not oc- 
cur without the previous association of 
nonobject and object patterns of stimula- 
tion. All of these limiting conditions 
seem necessary. The mediation process 
must include part of the same behavior 
made to the object if the sign is to have 
its representing property. What we have 
done here, in a sense, is to make explicit 
what may be implicit in Morris’s term “dis- 
position.” The last stipulation adds the 
learning requirement lacking in Morris’s 
formulation, The response of warrior- 
termites to pounding on the tunnel floor 
is ruled out because it does not depend 
upon previous association of pounding 
with a breach in the nest. Notice, how- 
ever, that there is no requirement here 
that the overt responses to the sign be in 
any way related to those made to the ob- 
ject; this is in direct contrast to Morris's 
position. 

This conception of the sign-process is 
not concocted solely to meet the needs 
of semantics; it is the application of a 
general theory of learning to this particu- 
lar class of phenomena. The mediation 
theory has been described in detail in an 
earlier chapter. At this point we shall be 
content to trace and illustrate the de- 
velopment of certain sign-processes as 
they apply to the problem of meaning. 
Paradigm A in Fig. 1 gives an abbre- 
viated symbolic account of the develop- 
ment of a sign ([§]) via direct associa- 
tion with the stimulus-object signified. 
Paradigm B gives a similar account, nec- 
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essarily somewhat more elaborate, of the 
development of an assign (/S/), which 
achieves its meaning indirectly through 
association with other signs rather than 
through direct association with stimulus- 
objects. 

As an illustration of a largely connota- 
tive sign we may use the word SPIDER. 
This has special reference to the writer, 
who as a 9-year-old was badly frightened 
by these stimulus-objects—his tent-mates 
at a boys’ camp, in ordinary youthful cal- 
lousness, told him they had put a nest of 
large gray spiders in his bunk, and he lay 
awake all night awaiting the first crawly 
contact! The stimulus-object (S), the ac- 
tual visual pattern of hairy-legged insect 
body, elicits a pattern of behavior (Rr), 
which in this case includes a heavy load- 
ing of autonomic “fear” activity. Through 
short circuiting, “detachable” portions of 
this total behavior to the spider-object 
(particularly “anxiety”) become condi- 
tioned to the sign, the word SPIDER. 
With repetitions of the sign-process, the 
magnitude of the representational media- 
tion process becomes reduced to some 
minimally effortful and minimally inter- 
fering replica—but still includes the re- 
lease of those autonomic reactions which 
literally confer the unpleasant, connota- 
tive meaning of threat upon this word. 
This mediating reaction (rm) produces 
a distinctive pattern of self-stimulation 
(Sm) which can elicit a variety of overt 
behaviors (Rx)—shivering and saying 
“agh!”, running out of a room when some- 
one says, “There's a spider in here.” An- 
other interesting phenomenon may be ob- 
served here: the overt behavior elicited 
by a sign may gradually operate to change 
its meaning, by exactly the same short- 
circuiting mechanism. In the present case, 
the writer, in his teens, deliberately tried 
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manipulating the spider-object, first at 
the end of a long stick and later even by 
holding it with his hand by its own 
strand. This repeated manipulatory be- 
havior gradually diluted the “anxiety” 
meaning of the sign. 

The word HAMMER will serve as an 
example of a largely denotative sign. The 
stimulus-object, a heavy thing having cer- 
tain visual characteristics and certain 
tactual and proprioceptive effects, elicits 
in the young child, usually under instruc- 
tions or imitation of some adult, a total 
pattern of behavior, including grasping 
and pounding movements. According to 
the mediation hypothesis, anticipatory 
portions of this behavior become short- 
circuited to the sign HAMMER. The 
process of reduction is especially impor- 
tant in the case of denotative signs—ob- 
viously, overt movements of the hands 
will interfere with other on-going instru- 
mental behaviors and therefore tend to 
be extinguished. A young child, however, 
may actually be observed to clench his 


FIG. 1. A. Development of a sign, A mini- 
mal but distinctive portion of the total 
behavior (Rr) originally elicited by an 
object (S) comes to be elicited by another 
pattern of stimulation ([S]) as a repre- 
sentational mediation process (rm), the 
self-stimulation (Sm) from which mediates 
various instrumental sequences (R+). This 
representational mediation process is the 
meaning of the sign. B. Development of an 
assign, Portions of the representational 
behaviors (rm, Srm) associated with a 
set of signs (Sı — Sn) transfer to a new 
pattern of stimulation, the assign (/S/), 
as a “distilled” representational process 
(fma), which becomes the meaning of this 
assign. From Osgood: The mediation hy- 
pothesis. 


hand and move it up and down when 
asked for “hammer.” 

Just what the representational processes 
may be that ultimately become associated 
with denotative signs in adult humans 
is entirely unknown. We have been treat- 
ing mediation processes as if they in- 
volved actual (though minimal) muscu- 


lar and glandular reactions, i.e. as if the 
Jacobson and Max peripheral theory of 
consciousness were valid. It is convenient 
to think of it this way, and hypotheses of 
testable nature can be generated—but 
the mediation notion does not require 
that mediators be peripheral. If we keep 
in mind that the representational media- 
tion process is a hypothetical construct, 
there is little danger in this approach; it 
could be entirely cortical without invali- 
dating behavioral implications. 

A very large proportion of the verbal 
signs used in communication are what 
we have termed assigns—their meaning 
is literally “assigned” to them via associa- 
tion, not with the objects represented but 
with other signs, Consider for example 
the word ZEBRA: This word is probably 
understood by most 5-year-olds, yet few 
of them have ever reacted in any way to 
the object itself. They have seen pictures 
of these animals in children’s books (sym- 
bols); they have been told that zebras 
have stripes (signs), run like horses 
(sign), and are usually found wild (sign). 
These previously established signs (or 
assigns) elicit certain meaningful reac- 
tions, and since the new assign is tem- 
porally contiguous with these reactions, it 
also tends to become conditioned to 
them. To the extent that an assign is as- 
sociated with many and varied signs (e.g. 
the class term, ANIMAL), its ultimate 
mediation activity would presumably be 
rather hybrid in nature—we know very 
little about this aspect of concept forma- 
tion. 

This analysis provides justification for a 
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recent educational innovation, phonetic 
reading. The stimulus patterns that ini- 
tially become signs of objects are gener- 
ally auditory in character, since the child 
learns its basic vocabulary in the informal 
contexts of spoken language. When he 
starts learning to read, the “little black 
bugs” on the printed page are definitely 
assigns; these visual patterns are seldom 
directly associated with the objects sig- 
nified, but rather with auditory signs 
(created by the child and teacher as they 
verbalize) and occasional visual symbols 
(pictorial representations of objects). Ob- 
viously, then, the more quickly the child 
can learn to make the right sound for the 
visual stimulus, the more quickly these 
new, visual assigns will acquire signifi- 
cance for him. The child already has 
meanings for “house,” “dog,” and even 
“typewriter” as heard stimulus patterns, 
but these mediating processes must be 
assigned to seen stimulus patterns. Our 
stereotyped notions of social reality are 
similarly derived. An “alien” is not some- 
thing directly contacted with the senses. 
This label has acquired its unsavory sig- 
nificance through association with assigns 
which have themselves only a mediate 
connection with objects and experi- 
ences. “We don’t want any enemy AL- 
IENS poisoning our country.” “That trou- 
blemaker is an ALIEN and ought to be 
shipped back where he came from.” This 
class of signs could appropriately be 
termed sign-assigns (e.g. signs-of-assigns), 
they are that far removed from direct con- 
tact with the objects they are supposed to 
represent. 
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18. 
The Psychologist Looks at Language*’ 


O. Hobart Mowrer* 


I. Signs and Sentences 


. . . It is certainly a common-place ob- 
servation that small children, well before 
they start speaking in formal sentences, 
communicate quite effectively—though, as 
we shall see, with definite limitations—by 
means of single words. And even at the 
adult level, we often make single words 
function as full sentences, in what Skinner 
(69) has called “mands,” i.e., demands, 
commands, exclamations, etc. But if we 
look closely at these so-called one-word 
sentences, we discover an interesting char- 
acteristic, namely that they always, or at 
least commonly, imply something else 
and thus function, in a restricted way, as 
a two-sign complex or true sentence. 
“Mands,” it seems, always refer to, or im- 
ply, some thing or person which is physi- 
cally present at the moment. Thus, if a 


*From O. H. Mowrer, The psychologist 
looks at language, Amer. Psychol., 9, 660- 
694 (1954). Reprinted by permission of 
the author and the American Psychological 
Association. 

1 Presented, in abridged form, as the 
presidential address at the sixty-second 
annual convention of the American Psy- 
chological Association. 


baby says, “Bottle,” it implies, “I want 
bottle”; and if an adult cries, “Stop,” he 
implies, “Discontinue what you are now 
doing.” Or, . . . the “Ouch” which the 
primitive man (or woman) uttered as a 
child was about to pick up a bee implied 
the bee and said, in effect, “Take care! 
That object is dangerous, will cause— 
pain.” We may say, therefore, that al- 
though a single word or phrase can tell us 
something (and thus function as lan- 
guage) with respect to something physi- 
cally present, it cannot tell us anything 
about what Hull has aptly referred to as 
“the not here and the not now” (28, p. 
524). To say anything about a physically 
or temporally remote thing, event, or per- 
son we must represent it symbolically— 
there is, apparently, no other option; and 


2 The list of references at the end of 
this paper very inadequately indicates the 
writer's indebtedness to others. Besides 
those specifically mentioned, various other 
persons have given generously of their 
knowledge and critical assistance, in con- 
versation and through correspondence. The 
writer warmly thanks colleagues and stu- 
dents both in his own department and 
elsewhere for their helpfulness. Special 
thanks are due to Dr. Charles E. Osgood, 
Mr. William G. Perry, Jr., Dr. Fillmore 
H. Sanford, and Dr. Laurance F. Shaffer 
for reading and very usefully criticizing a 
preliminary draft of this paper. 
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this involves a second sign, or term, to 
which conventially—and probably for very 
sound psychological reasons (see Sections 
II and III) —we give first place in the two- 
sign sequence. Thus, as Stewart so insight- 
fully observes, language comes into its 
own only with the development of the 
“noun-idea,” i.e, when sentences have 
“sign” subjects as opposed to “thing” sub- 
jects. And as we shall see in a later sec- 
tion, this is a feat which no infrahuman 
organism seems to have achieved, and one 
which it takes even the human organism a 
little while to get the hang of. 

In summary of our inquiry thus far, we 
may say, then, that the transition from the 
use of single signs to multisigns or lan- 
guage proper is, in some ways, insignifi- 
cant but in other ways truly momentous: 
It enables us to go from the concrete to 
the abstract, from the here-and-now to the 
“not here, not now.” Our next major task 
is to clarify and expand this assumption 
and to indicate in more detail just how 
the grammatical unit or complex which 
we call the sentence works.® 


II. What Do Sentences Do? 


In the preceding discussion we have 
asked, and in at least a preliminary way 
answered, the question: What is the na- 
ture of a sentence? We have tried, that is 
to say, to determine what sentences, sci- 
entifically considered, are. In the present 
section an attempt will be made to dis- 
cover what sentences do, i.e., how they 
work, psychologically speaking. 

There is a very widespread assumption, 
which we will later have occasion to ques- 
tion, that in the process of spoken or writ- 
ten communication we, somehow, trans- 
fer meanings from mind to mind. To 
communicate, it is suggested, is to make 
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something common, shared; and this 
something is meaning, understanding, 
thought, knowledge, ideas, information. 
One writer puts the matter this way. He 
says that language, broadly speaking, is 
characterized by a “transfer of meaning.” 
It is the device “by which men have con- 
veyed significant messages to one another 
since the dawn of history.” “Meaning 
may be transferred by devices that have 
nothing to do either with the spoken lan- 
guage or with its written counterpart, and 
this basic proposition few will be so hardy 
as to deny” (58, p. 10). 

Another writer says: 


When the day arrived on which one per- 
son could make such movements, gestures, 
or grimaces as would lead another person to 
avoid or to accept an object, that is to say, 
when a meaning could be transferred to one 
mind from another, language was created 
(24, pp. 207-208). 


And yet another says: 


The philosophy of language, we may then 
say, to begin with, is concerned with the 
evaluation of language as a bearer of mean- 
ings, as a medium of communication and as 
a sign or symbol of reality (81, p. 37). 


And to this the same writer later adds: 


On the question as to what linguistic fact 
is not, linguists are in general agreed. They 
are also agreed upon what it is that con- 
stitutes positively linguistic fact. The sine 
qua non of language is precisely the meaning 
of which the sounds, the motor processes 
and tactual sensations, are the bearers (p. 


66). 


The first of the writers just cited is a 
linguist, the second a psychologist, and 
the third a philosopher. We thus see how 
widely accepted is the notion that the 
basic function of language is to transfer or 


Communication 


178 
bear meanings from person to person, 
from mind to mind. 

It is not hard to understand how this 
conception of language has arisen; and, as 
we shall see later, there is a certain limited 
sense in which it is undoubtedly correct. 
But in another, perhaps more basic sense, 
this notion seems to be wide of the mark 
and to have been a barrier to the develop- 
ment of a psychology of language with 
real “power.” 

Let us explore now, instead, the prop- 
osition that in communication we are not 
transferring meanings from person to per- 
son so much as we are transferring mean- 
ings from sign to sign within a given per- 
son, within a single mind. Said a little 
differently, the suggestion is that in order 
for us to communicate effectively with an- 
other person, he must already have the 
meanings with which we shall be dealing 
and that in the communicative act we are, 
for the most part, merely changing the 
signs to which particular meanings are 
attached, merely shifting or transferring 
meanings from one sign to another. One 
person, by the use of appropriate words or 
other signs, can arouse, or “call up,” par- 
ticular meanings in the mind of another 
person; but he does not transfer or im- 
plant them there. The communicative 


10 The three quotations cited are from 
books published, respectively, in 1949, 
1924, and 1939. In Greenough and Kit- 
tredge’s book, Words and Their Ways in 
English Speech, published in 1906, we find 
the same general thesis formulated thus: 
“Language is the expression of thought by 
means of words” (23, p. 2). And even in 
Fries's otherwise very adventurous book, 
The Structure of English: An Introduction 
to the Construction of English Sentences, 
published in 1952, we find the author say- 
ing that he does not “deny that the chief 
business of language is to communicate 
meanings of various kinds” (22, p. 8). 


act, in its most salient and significant 
aspect, lies rather in the combination, 
juxtaposition, or association of the mean- 
ings thus aroused in novel, “informative” 
ways. 

A rudimentary sentence will illustrate 
this notion. Let us assume that John is 
telling Charles that: Tom is a thief. It is 
clear, is it not, that for the intended 
effect to be produced by this sentence, 
Charles must already know Tom and must 
know about thieves and thievery. In other 
words, Charles must already have mean- 
ings attached to the words, Tom and 
thief. What, then, is the function of the 
sentence, “Tom is a thief’? Most simply 
and most basically, it appears to be this. 
“Thief” is a sort of “unconditioned stim- 
ulus”—we shall later want to qualify this 
term, but for the moment it will suffice— 
a sort of “unconditioned stimulus” which 
can be depended upon to call forth an 
internal reaction which can be translated 
into, or defined by, the phrase, “a person 
who cannot be trusted,” one who “takes 
things, steals.” When, therefore, we put 
the word, or sign, “Tom” in front of the 
sign “thief,” as shown in Fig. 1, we create 
a situation from which we, as psycholo- 
gists, can predict a fairly definite result.* 
On the basis of the familiar principle of 
conditioning, we would expect that some 


13 In the above analysis the copula and 
indefinite article are omitted on the as- 
sumption that, in a present indicative sen- 
tence, they are really unessential. Support 
for this position is provided by the follow- 
ing excerpts from a recent letter from Pro- 
fessor Gregory Razran. He says: “The Rus- 
sian equivalent of the English, ‘I am a 
thief,’ is ‘Ya Vor.’ The copula is always 
omitted in modern Russian in the present 
indicative, but is not omitted in Czech 
and Polish. The copula was not omitted 
in Old Slavic. Yet it would be incorrect to 
attribute such omissions to modern de- 
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of the reaction evoked by the second sign, 
“thief,” would get shifted to the first sign, 
“Tom,” so that Charles, the hearer of the 
sentence, would thereafter respond to the 
word, “Tom,” somewhat as he had previ- 
ously responded to the word, “thief.” . . . 

Although the notion that the essence of 
language involves predication, i.e. the 
temporal conjunction of something called 
a subject with something called a predi- 
cate, is ancient and widespread," there 
has recently been considerable tendency 


“Tom (is a) thief.” 


“Tom's. _ 


“thief"——=> ry 
“Tom”. f 


FIG. 1. Diagram illustrating how the 
sentence, “Tom is a thief,” can be recast 
in the vernacular of conditioning theory. 
From Mowrer: The, psychologist looks at 
language. 


velopments, since such copulas are also 
absent in ancient Hebrew. Moreover, . . . 
such copulas may also be omitted in Latin 
and Sanskrit (one may say in Latin, “Ego 
fur sum,’ as well as, for emphasis, ‘Ego 
fur.’). As far as I know, Slavic languages 
have neither a definite nor an indefinite 
article, while Hebrew has a definite but not 
an indefinite article. The indefinite article 
in Teutonic and Romance languages seems 
to have developed from ‘one,’ as notice 
their identity in German, French, Spanish, 
and Italian, and, I believe, also in Old 
English. However, there is the differentia- 
tion of ‘a’ and ‘an’ from ‘one’ in modern 
English.” 
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to replace it with the view that single 
words and sentences do not differ basi- 
cally. In their book, The Meaning of 
Meaning (54), published in 1923, Ogden 
and Richards, while accepting the hy- 
pothesis that words arouse but do not 
“convey” or “bear” meanings,” neverthe- 
less take the position that a sentence is 
just a complex sign. They say: 


Thus the reference of “‘larks sing,” since it 
has two components, will differ from that of 
“Jarks” just as do “soaring larks” or “lark 


14 “Thus Sapir is voicing a view very 
prevalent among philologists, when he 
writes, ‘There must be something to talk 
about and something must be said about 
this subject of discourse once it is selected. 
. . . The subject of discourse is a noun. 
. . . No language wholly fails to distin- 
guish noun and verb” (54, p. 260). “For 
centuries it has been insisted that, for com- 
pleteness, every sentence must have a word 
representing a person, place, or thing, and 
also a word ‘asserting’ or ‘saying something’ 
about that person, place or thing. There 
must be a ‘subject’ and a ‘predicate’ ” (22, 
p. 14). 

15 Malinowski wrote an essay entitled 
“The Problem of Meaning in Primitive 
Languages” which Ogden and Richards 
published as part of their book and which 
Osgood (55), in discussing the notion that 
words “carry” meanings from person to 
person, cites as follows: “Malinowski aptly 
dubbed this naive conception the ‘bucket 
theory’ of meaning—words like little buck- 
ets are assumed to pick up their loads of 
meaning in one mind, carry them across 
intervening space, and dump them in an- 
other mind. ‘This attitude in which the 
word is regarded as a real entity, contain- 
ing its meaning as a Soul-box contains the 
spiritual part of a person or thing, is shown 
to be derived from the primitive, magical 
uses of language and to reach right into the 
most important and influential systems of 
metaphysics. Meaning, the real “essence” 
of a word, achieves thus Real Existence in 
Plato’s realm of Ideas . . .’” (41, p. 680). 
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ie,” being also dual references. This dif- 

erence is therefore unessential, though most 
complex references do in fact use the propo- 
sitional form (p. 259). 


In his Signs, Language, and Behavior 
(47), Morris says: 


The fifth criterion requires that language 
signs be combinable with each other in cer- 
tain ways and not in others, and that these 
combinations form a complex sign... . 
Hull has suggested that such combinations 
are to be explained in terms of simultaneous 
and temporal stimulus patterning, since 
“, . „ In reading, each letter is a complex 
visual pattern, each word is a complex pat- 
tern of these letter patterns, and each sen- 
tence is a temporally patterned sequence of 
printed word patterns” (p. 58). 


And more recent and more explicit still 
is the following formulation by Dollard 
and Miller (17): 


As has already been pointed out, a person 
can learn to respond to specific combinations 
of stimuli or relationships among them and 
to make different responses to the same cues 
in different contexts. This is called pattern- 
ing. A person’s responses to the words that 
he hears someone else speak obviously in- 
volve patterning. Thus a parent will respond 
quite differently to the following two reports 
containing the same words in different se- 
quences: “Jim hit Mary” and “Mary hit 
Jim.” This is an exceedingly simple example. 
Although scarcely a beginning has been 
made toward the study of language from the 
point of view of learning theory, it is obvious 
that man’s great innate capacity and rigor- 
ous social training have produced marvel- 
ously intricate and subtle patterning in his 
responses to spoken language (p. 100).1¢ 


16 The notion that language is just a 
form of interpersonal stimulation and re- 
sponse is undoubtedly a product of the era 
of behaviorism; and it achieved one of its 
earliest, clearest, and most influential for- 
mulations in the writings of Bloomfield (6). 


The notion under examination in the 
present paper is different. It is that the 
sentence is, preeminently, a conditioning 
device, and that its chief effect is to pro- 
duce new associations, new learning, just 
as any other paired presentation of stimuli 
may do, This position is congruent with 
the traditional notion that predication is 
the essence of language and may indicate, 
perhaps more precisely than purely lin- 
guistic research has done, the basic nature 
of this phenomenon." 


In a chapter on “The Use of Language,” 
Bloomfield says: “Language enables one 
person to make a reaction (R) when an- 
other has the stimulus (S). In the ideal 
case, within a group of people who speak 
to each other, each person has at his dis- 
posal the strength and skill of every person 
in the group. . . . The division of labor, 
and, with it, the whole working of human 
society, is due to language” (p. 24). Thus 
a person with a need or wish may respond 
either by trying to deal with the need him- 
self (“practical action”), or he may try to 
stimulate someone else to do it for him 
(“linguistic substitute reaction”). The 
latter situation Bloomfield represents as 
follows: S (first person’s problem or need) 
> r (speech reactions) > S (speech as 
heard by another person) > R (the instru- 
mental response or work done for the first 
person by the other person). Here the 
recipient of the speech stimulus is what 
Courtney (13), in discussing the child- 
mother relationship, has called a “medi- 
ator” (not to be confused with “mediating 
response,” Sections III and IV). While 
widely accepted (see Fries, 22, ch. III), 
this conception of language seems greatly 
oversimplified: it ignores the phenomenon 
of predication (making a sentence basically 
the same as a stimulus) and bypasses the 
whole problem of meaning, knowledge, 
information, i.e., mediate as opposed to im- 
mediate behavior, predispositions to action 
as opposed to direct response. 

17 Īn thus emphasizing predication, the 
writer does not exclude the possibility that 
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This notion is presented here in a IMI. The Concept of Mediation 
frankly exploratory manner, as a hypothe- 
sis which others are invited to consider 
and test against the prevailing concepts 
and facts of their particular specialties. 
The remainder of this paper will be con- 
cerned with an examination and elabora- 
tion, both theoretical and empirical, of 
this hypothesis from a psychological point 
of view, with special reference to learning 


Perhaps the most generally accepted 
criterion as to whether a sentence has or 


Carpenter (10a), entitled “A theoretical 
orientation for instructional film research,” 
we find brief reference to the “releasor- 
organizer hypothesis,” which is “that the 
signals, signs, and symbols of sound motion 
pictures function principally as releasors 


theory.17 


word combinations not involving predica- 
tion (in the English sense of that term) 
may function as sentence equivalents. Con- 
sider this observation by Wyatt: “At the 
age of sixteen and a half months [Nana] 
said bighorsy, pronouncing it like one word. 
She then began to take the word ‘big’ out 
of the compound and to combine it with 
other words: big hat, big bag, and so on” 
(88, p. 29). One cannot escape the feeling 
that big hat and even bighorsy may be 
roughly equivalent, functionally, to “The 
hat is big,” “The horse is big.” Wyatt 
further observes that “Sapir has proved 
that in all known languages juxtaposition is 
the simplest, most economical method of 
binding words together and of bringing 
them into some relation to each other, 
without attempting an inherent modifica- 
tion of these words. “The very process of 
juxtaposing concept to concept, symbol to 
symbol, forces some kind of relational 
feeling, if nothing else, upon us. Words and 
elements, once they are listed in a certain 
order, tend not only to establish some 
kind of relation among themselves but are 
attracted to each other in greater or in less 
degree’” (88, p. 31). Perhaps it should be 
said that in the present paper we are ex- 
amining the psychological implications of 
one form of word “juxtaposition,” namely 
the propositional or subject-predicate form. 
Whether other forms of juxtaposition in- 
volve different psychological principles is at 
present an open question (see Section X). 

17 Since this paper went to press, the 
writer has discovered a very closely related, 
but unelaborated, conception of the com- 
municative process. In a recent paper by 


and organizers of meanings and responses 
in human subjects” (p. 42). The releasing 
function of signs is said to be “both de- 
pendent (or interdependent) on the stimu- 
lation and on the activated brain processes 
(‘engrams’) of the experiencing subjects. 
Thus, it may be reasoned that the func- 
tions of signals, signs, and symbols is to 
release responses in subjects. . . . Signs 
and symbols do not transmit meanings; 
they release meaning when and only when 
the subjects respond. The characteristics 
of these responses relate closely to personal 
life history differences” (pp. 42-43). The 
author continues: “The releasor concept of 
signs and symbols must be supplemented 
by the related organizer concept. Previously 
learned ‘engrams’ may be modified by new 
stimulation, and even new related elements 
may be ‘imprinted.’ New relationships may 
be shown, and old responses modified by 
film mediated stimulation. The results are 
conceived to consist principally of the re- 
organization of previously learned neural- 
organic patterns which intervene between 
film stimulation and the subsequent actions 
or reactions of the individual” (p. 43). 
The notion that signs release, or arouse, 
meanings in rather than “bear” them to 
another individual, as stated by Carpenter, 
is identical with the position taken in the 
present analysis. The “organizer” concep- 
tion, while stated in somewhat different 
terms, is also believed to be essentially 
congruent, at a relatively abstract level, 
with the theory of sentence function as 
here developed. Whether the notion of 
“reorganization” can, without injustice, be 
analyzed in terms of conditioning and 
mediation (see next section) or whether 
more holistic principles are required (see 
Section X) is uncertain. 
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has not done its work is this: If, as a result 
of hearing or reading a sentence, an in- 
dividual’s behavior, on some future occa- 
sion, with respect to some person, thing, 
or event not present when the sentence 
occurred, is different from what it would 
otherwise have been, then that sentence 
may be said to have been “understood” 
and to have functioned effectively. If, for 
example, John tells Charles, in the ab- 
sence of Tom, that Tom is a thief and if, 
when Charles subsequently encounters 
Tom, he reacts toward him with distrust 
and apprehension, communication has 
clearly taken place. 

But this criterion of linguistic action 
poses an interesting problem for the be- 
havioral scientist. As psychologists, we 
are all quite familiar with situations in 
which an organism learns, or is taught, to 
react to a sign more or less as if it were 
the thing or event signified. In the ver- 
nacular of the conditioning laboratory, 
the organism, after conjoint exposure to 
the conditioned stimulus and the uncon- 
ditioned stimulus, reacts to the CS some- 
what as if it were the UnCS. Or, as we 
may equivalently say, the meaning of the 
UnCS “moves forward” and becomes an- 
ticipatory. 

This phenomenon seems to occur in 
language, true enough, as when the predi- 
cate meaning of a sentence “moves for- 
ward” and gets connected to the sentence 
subject. But in language something else, 
of a different nature, is also involved. This 
is the remarkable, and indeed somewhat 
paradoxical, phenomenon of an organism, 
after exposure to a sentence, reacting to 
some thing, event, or person as if it were 
the corresponding sign or symbol which 
was the subject of the sentence. In other 
words, the new meaning attached, by 
means of predication, to the sign consti- 
tuting the subject of a sentence has a 


tendency to shift or transfer “back,” so to 
say, to the thing, event, or person which 
the subject of the sentence represents, or 
“stands for.” This is a phenomenon to 
which comparatively little attention has 
been given but which can be satisfactorily 
accounted for on the basis of well-known 
principles. 

Let us note, first of all, that what we are 
positing here is something quite different 
from so-called backward conditioning. 
This is fortunate, for backward condition- 
ing is a questionable, controversial type 
of event, whereas the phenomenon with 
which we are here concerned seems, as 
phenomenon, not to be in the least ques- 
tionable. We are, however, in need of a 
precise explanation. Let us begin by mak- 
ing a more detailed diagrammatic analysis 
of the sentence, “Tom is a thief.” In Fig. 
1 we have already seen how the familiar 
principle of conditioning can explain the 
fact that some part of the reaction evoked 
by the word “thief” gets connected to the 
word “Tom,” but we have not as yet said 
anything about the sequence of events 
whereby “Tom” and “thief” originally 
acquired their meanings. As Fig. 2 shows, 
the word “Tom” acquired its meaning 
by being associated with, and occurring in 
the context of, Tom as a real person. Tom 
himself has elicited in John and Charles 
and others who have had first-hand con- 
tact with him a reaction which we can 
label, Rr, of which rr is a component. 
And as a result of the paired presentation 
or concurrence of “Tom” the word and 
Tom the person, the component, or “de- 
tachable,” reaction, rz, gets shifted from 
the latter to the former.!* 


18 It may be helpful to think of the Ry 
reaction, mentioned above, and the so- 
called “detachable component,” rz, as 
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FIG. 2. Schematic indication of the way 
in which the word, “Tom,” through the 
process of conditioning, comes to denote, 
mean, or imply a certain person, Tom. 
From Mowrer: The psychologist looks at 
language. 


And similarly for the word, “thief.” As 
indicated in Fig. 3, this word is likewise 
presumed to have acquired its distinctive 
meaning by having been used in the pres- 
ence of, or to have been, as we say, “‘asso- 
ciated with,” actual thieves. Therefore, 
when we make the sentence, “Tom (is a) 
thief,” it is in no way surprising or incom- 
prehensible that the rẹ reaction gets 
shifted, as originally shown in Fig. 1, from 
the word, “thief,” to the word, “Tom.” 
This is seemingly a straightforward in- 
stance of second-order conditioning: By 
first-order conditioning some part of the 
total reaction elicited by real thieves gets 
shifted to the word, “thief,” and by sec- 
ond-order conditioning of the type pro- 
vided by the sentence, this same reaction, 
with some attenuation or weakening, gets 


analogous, respectively, to the total re- 
action produced by an electric shock in a 
rat and the reaction produced by a stimulus 
which is merely a sign of shock. Shock pro- 
duces sensations of pain and also fear; but 
it is only the latter which gets conditioned, 
or “detached,” and occurs anticipatorily, to 
a mere signal or sign of shock. 
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“thief 
ete) 
thier —R, 


“thief” —r, 


FIG. 3. Replication of Fig. 2 showing how 
the word, “thief,” acquires its distinctive 
meaning. From Mowrer: The psychologist 
looks at language. 


further transferred or shifted to the word 
“Tom.” 

Our analysis thus far is, however, either 
incomplete or faulty, for if language 
worked precisely as suggested, it would 
pretty obviously not do what we want it 
to do and what, a good deal of the time, 
it manifestly does. If language worked as 
thus far indicated, the sentence, “Tom is 
a thief,” would serve merely to change the 
meaning of “Tom,” so that when Charles, 
as the recipient of this sentence, subse- 
quently heard this word, it would remind 
him less or perhaps not at all of Tom but 
rather of thieves. It would, in other words, 
become just a synonym for the word, 
“thief,” and we would have simply an in- 
stance of reconditioning, a procedure 
whereby the noise, “Tom,” would lose its 
old meaning and acquire a new, different 
one. This type of conditioning, or recon- 
ditioning, would, pretty obviously, not 
serve our communicative needs at all and 
would soon lead to utter chaos,!® Clearly, 


19 Some premonition of what this might 
be like, on a general scale, is suggested by 
the experience which many persons report 
of sometimes repeating two or three times 
(either to themselves or aloud) some word 
whose meaning is not very well established 
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something essential is missing here; but, 
fortunately, the difficulty is easily reme- 
died. 

In drawing a diagram of conventional 
type to represent conditioned-response 
learning, we are likely to represent the 
UnCS and the response it elicits and then, 
in adding the CS, to say something like 
this: “This is an originally neutral stimu- 
lus. Oh, to be sure, it probably evokes 
some reaction, but for our purposes it is 
not important.” Thus we end with a 
drawing something like that shown in 
Fig. 4. 


CS<——R? 


~ 
op 


UnCS —~UncR 


FIG. 4. Conventional conditioning dia- 
gram, indicating the common neglect of 
the reaction originally produced by the 
conditioned stimulus. From Mowrer: The 
psychologist looks at language. 


But if we are to succeed in making con- 
ditioning theory account for the basic 
facts of language, we must manifestly pro- 
ceed a little differently at this point. As 
already indicated, particularly in Fig. 2, 


and finding that the word “‘loses its mean- 
ing,” more or less completely. The word 
becomes, so to say, “blank,” a mere empty 
sound, The problem which language theory 
manifestly poses for us in this connection 
is that of determining how it is that a 
word, as the subject of a sentence, can take 
on some of the denotation, or at least con- 
notation, of the predicate of the sentence 
and still retain its original meaning, (But 
see Section IV.) 


the subject, or “CS,” in our specimen sen- 
tence has, by assumption, a very definite 
reaction potential or meaning, which we 
have designated as rr. Let us, therefore, 
redraw Fig. 1 and, instead of ignoring rp, 
let us give it rightful recognition in the 
diagram. Figure 5 is the result. 

Assuming now, as we reasonably may, 
that the ““Tom”——ry connection is a rel- 
atively stable one, we will expect the con- 
ditioning outcome shown at the bottom 
of Fig. 5. Instead of r, the thief-meaning, 
getting connected directly to the word, 
“Tom,” and more or less replacing the rp 
reaction, we may infer that r, will get 
conditioned rather to the reaction—or, 
more accurately, to the stimuli or sensa- 
tions produced by the reaction—which 
the word “Tom” produces, namely rp. 
This internal reaction, or meaning, thus 
becomes what Lumsdaine (38), Foley 
and Cofer (20), Osgood (56), and others 
have recently called a mediating response, 
and its importance is indicated by the 
felicity with which it delivers us from the 
difficulties into which a too simple, too 
abbreviated analysis of language in terms 
of conditioning plunges us. 

If our specimen sentence worked as 
Fig. 1 implies, i.e., if the thief-meaning, 
T, got conditioned directly to the word, 


“Tom (is a) thief.” 


ais 


~ 


“thief >r 
“Tom'"— t7 ——Tt 


FIG. 5. Replication of Fig. 1, but with the 
mediating response, rr, included rather 
than omitted. From Mowrer: The psy- 
chologist looks at language. 
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“Tom,” and thus more or less replaced 
the Tom-meaning, rp, then there would 
be only one apparent way in which the 
thief-meaning could get transferred to 
Tom as a person, namely for Tom-the- 
person, when encountered, to elicit in 
Charles a labeling reaction, which would 
involve his saying, at least subyocally, the 
word, “Tom,” which in turn would then 
elicit the thief-meaning, r; (see Fig. 6). 
While this hypothesis is logically tenable 
and may in some cases correspond to re- 
ality, it has, as will be shown in the next 
section, rather limited applicability. 
Moreover, a different way of looking at 
the same problem is immediately avail- 
able which seems much less restrictive.” 

We have already posited (see Fig. 2) 
that the meaning reaction, rr, which gets 
connected to the word, “Tom,” is a com- 
ponent of Rr, which is the reaction or 


“Tom” 


rt 
Tom——"Tom’—— rt 


FIG. 6. A possible, but not entirely satis- 
factory, conception of how a meaning 
acquired by a word (“Tom”) can get 
transferred to the thing or person (Tom) 
represented by the word. From Mowrer: 
The psychologist looks at language. 


20 Dollard and Miller (17, see especially 
ch. VI) have developed in considerable 
detail the notion of response generalization 
and transfer (as well as discrimination) 
through “labeling.” However, they agree 
that such generalization may occur on the 
basis of “labeling or other cue-producing 
responses” (p. 105). Thus they do not 
exclude as a possibility the mechanism 
which is to be emphasized in the following 
discussion, 
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reaction complex evoked by Tom himself; 
and we have also posited (see Fig. 5) that 
the sentence, “Tom (is a) thief,” will 
cause the thief-meaning, rs to get con- 
nected to rp. Therefore, when Tom-the- 
person is subsequently encountered by 
Charles, he will elicit in him the Rp reac- 
tion, of which ry is a part, which will in 
turn elicit the thief-meaning, r. Q.E.D. 
This mechanism for the occurrence of 
semantic generalization or meaning trans- 
fer from sign to thing is shown schemati- 
cally in Fig. 7 and is characterized by 
relative simplicity yet also possesses, seem- 
ingly, considerable generality and explana- 
tory vigor. In the next section we shall 
look for other than logical evidence to 
support such a notion," 


Test ms 
(t--)——r, 
Tom——R? ; 


FIG. 7, Indication of how rz, in the 
example given, functions as a “mediating 
response.” Cf, Fig. 5 and Fig. 2. From 
Mowrer: The psychologist looks at lan- 


guage. 


21 Interestingly enough, this hypothesis 
has at least verbal similarity to the “‘identi- 
cal-elements” theory of “transfer of train- 
ing” as advanced by Thorndike (77) and 
others. A mediating reaction, such as ry in 
the above example, is an “identical ele- 
ment” in the reaction produced by both 
the word, “Tom,” and the person, Tom. 
Therefore, if, by means of the Tom-is-a- 
thief sentence, we get a new meaning- 
reaction, 1, conditioned to ry as elicited 
by the word, “Tom,” we will expect it to 
generalize to rp as elicited (in the context 
of the total Rp) by the person, Tom. 
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IV. Verbal and Nonverbal Examples 
of Response Mediation 


As Osgood has remarked, the concept 
of mediation is not devised “solely to 
meet the needs of semantics; it is the ap- 
plication of a general theory of learning 
to this particular class of phenomena” 
(55, p. 696). Two of the experiments 
which are most relevant in this connec- 
tion have been concisely summarized by 
Osgood as follows: 


Fortunately [he says] there are cases in 
which the mediation process is specifiable 
with some accuracy. Shipley [68] paired a 
faint light with a sudden tap on the cheek, 
which elicited winking; then the tap was 
paired with shock to the finger, eliciting 
withdrawal; on subsequent tests, the light 
flash (never paired with shock) evoked 
finger withdrawal. Since this did not occur 
unless the light and tap had initially been 
paired, any sensitization explanation is ruled 
out. . . . It becomes evident that the only 
difference between this experiment and 
those on sensory conditioning lies in the 
specificity of the mediating reaction—here, 
the winking movement (55, pp. 461-462). 


This experiment is schematized in Fig. 8 
and provides a nice example of how it is 
that a response, in this case the eye blink, 
can, so to say, “carry” another response, 
finger flexion, from one stimulus (tap on 
cheek) to another (light) without the 
latter having ever been used either as a 
conditioned or an unconditioned stimulus 
for the elicitation of the flexion response. 
This, in essence, is the mechanism posited 
in the preceding section to explain how it 
is that, in a sentence, a meaning condi- 
tioned to another meaning, i.e., to the 
mediating response, can generalize or 
transfer back to the object represented by 
the sign that elicits the mediator or, more 


precisely, to the response elicited by that 
object.?? 

However, since the Shipley experiment 
was done without reference to the media- 
tion hypothesis and with no particular 
attention being paid to the blink reaction 
in the second stage of conditioning, it is 
important to ask, as does Osgood: 


But did this mediating winking reaction 
actually occur? [By way of reply, this writer 
goes on to say:] Lumsdaine [38; cf. pp. 
230 ff. in Hilgard and Marquis, 26] has re- 
peated Shipley’s experiment with detailed 
graphic recording. His records indicate that, 
in most cases the light did elicit a winking 
movement which was closely followed by 
finger withdrawal. There were some cases, 
however, in which the withdrawal reaction 
antedated the eyelid movement, and this 
suggests that the winking movement may be 
only an overt index of the actual mediation 


22 It should be noted, however, that the 
Shipley experiment does not provide an 
exact parallel of what happens in language. 
There the new meaning is acquired by the 
mediating reaction as produced by a word 
(conditioned stimulus) and generalizes to 
the thing (unconditioned stimulus); 
whereas, in the Shipley experiment, the 
new response (finger flexion) is condi- 
tioned to the mediating reaction (blink) 
as produced by the tap (unconditioned 
stimulus) and generalizes to the light 
(conditioned stimulus). Experiments cited 
later in this section show that “semantic 
generalization” of conditioned reactions 
occurs from thing to cognate word as well 
as from word to thing. But ordinarily, in 
language, we are more concerned with the 
latter occurrence than with the former. 
For the Shipley paradigm to have been 
strictly parallel to this type of generaliza- 
tion, finger flexion should have been con- 
ditioned to blink as elicited by light (a 
conditioned stimulus) so that the flexion 
could have generalized to the tap (or un- 
conditioned stimulus) . 
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Light~.__ 
Tap—=Blink 
Light ——Blink 


Tap—— Blink ~___ 
Shock—== Finger flexion 


Tap——Blink— Finger flexion 
Light ——Blink— Finger flexion 


FIG. 8. An example of response mediation 
discovered, rather accidentally, by Shipley 
(68). The assumption is that in the second 
stage of conditioning (lines four and five), 
the finger flexion gets attached, not 
directly to the tap stimulus, but to the 
response (blink) produced by the tap 
(see next to last line). (More precisely 
said, the finger flexion gets conditioned to 
the proprioceptive and other stimuli pro- 
duced by the blink—or to the central 
equivalents of the blink, See text.) And 
since light, as a result of the first stage of 
conditioning, is also capable of producing 
the blink reaction, it follows that the 
light, through the inter-mediation of the 
blink, will produce finger flexion (see last 
line), even though the light has itself 
never been paired with tap, the uncondi- 
tioned stimulus for finger flexion. From 
Mowrer: The psychologist looks at lan- 
guage. 


process. This is what would be expected 
according to the mediation hypothesis: in 
the original training, the light (sign) was 
presumably becoming associated with the 
fractional anticipatory portions of the reac- 
tion to tap-on-cheek (stimulus-object), and 
it is this mediation process which is more or 
less faithfully indexed by the overt winking 
(55, p. 462). 


Elsewhere in his book, Osgood (see 
also Cofer and collaborators [12]) cites a 
number of other instances of response 
mediation, reported mainly by Russian 
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investigators, in which responses condi- 
tioned to words readily generalized to the 
objects they represent and in which 
responses conditioned to objects general- 
ized to cognate words. Against the back- 
ground of these findings, it is not surpris- 
ing to discover, as Razran (61) has, that 
a salivary response conditioned to one 
word, e.g, “style,” will readily generalize 
to another word, viz., “fashion,” which is 
physically very different but which elicits 
much the same meaning or mediating 
reaction. In fact, this investigator found 
that considerably more generalization of 
conditioning (59% as opposed to 37%) 
occurred on the basis of similarity of 
meaning (synonyms) than on the basis of 
similarity of sight or sound (homophones, 
eg, in the present instance, to a word 
like “stile” ). That some transfer occurred 
on both bases suggests that, in the Razran 
experiment, the salivary response was con- 
ditioned not only to the meaning reaction 
produced by the word “style” but also, to 
some extent, directly to the word itself. 
To the extent that this occurred we may 
say that salivation replaced the meaning 
response previously attached to this word, 
i.e., its meaning was changed; but this was 
not the only, or even the main effect, 
since transfer on the basis of the media- 
tion mechanism was greater. 

No, the notion of response mediation— 
Hull (28) spoke of “pure stimulus acts,” 
Hilgard and Marquis (26), of “intermedi- 
ate responses”—is by no means invented 
“to meet the needs of semantics.” It is a 
common and well-established phenome- 
non whose centrality in language can 
hardly be doubted and which apparently 
can alone explain, broadly yet simply, how 
it is that what we learn through sentences 
can generalize, or transfer, despite absence 
of any sensory similarity or continuum, 
both to other words of similar meaning 
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and also to the realities thereby denoted.?* 

In concluding this section, it may be 
useful to emphasize a distinction which is 
implicit in the foregoing but which may 
have become somewhat obscured in the 
course of the discussion. We have seen, 
first of all, that the basic function of the 
subject-predicate unit which we call a 
sentence is to condition the predicate 
meaning so that it will later be connected 
to and elicited by the subject meaning. 
This we have referred to, somewhat ellip- 
tically, as a transfer of meaning from sign 
to sign, as opposed to mind to mind. And 
in the consideration of semantic gener- 
alization we have likewise spoken of trans- 
fer. What needs to be particularly noted 
here is that the kind of “transfer” in- 
volved in the two cases is different; in the 
first instance it involves transfer in the 
sense of conditioning and, in the second 
instance, in the sense of generalization. 
The two phenomena can be easily con- 


23 A psychologist can hardly think about 
response mediation as it functions in lan- 
guage without also being reminded of at 
least some of the phenomena implied by 
the word “insight.” In the published re- 
port of one of the first experiments in 
which response mediation was unequivo- 
cally demonstrated, the author, N. E. 
Miller (45), while making no reference to 
language, speaks repeatedly of “insight” 
and “foresight” (see also May, 43; Nygaard, 
53; and Mowrer, 52, ch. 5 and 11). For a 
consideration of insight with special ref- 
erence to “transfer of training,” see 
Thompson (75, p. 165); see also the dis- 
cussion of language and the syllogism, 
Section VIII. For experiments and theo- 
retical discussions bearing on the problem 
of “latent learning” but which are also 
relevant to the concept of mediation, see 
Tolman and Gleitman (78) and Strain 


(72). 


fused if something of an effort is not made 
to keep them distinct.2# 
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19. 
Operant Learning Principles and Communication* 


Arthur W. Staats 


Mowrer (1954) has suggested how one 
type of communication may be accounted 
for through the application of learning 
principles—in this case the principles of 
respondent conditioning and mediated 
generalization, This classic article makes 
an analysis of one function of language, a 
function which would seem to be wide- 
spread and important to much human 
learning. Nevertheless, the analysis does 
not tap the various principles of learning 
which appear to be important in the de- 
velopment of language and its function in 
verbal interactions popularly described as 
communication. The present article will 
analyze several aspects of operant condi- 
tioning within this area of communica- 
tion. 


* From A. W. Staats, Operant learning 
principles and communication, Technical 
Report No. 26, Contract No. Nonr- 
2794(02) between the Office of Naval 
Research and Arizona State University, 
February 1964. 


For purposes of this discussion, verbal 
communication will be considered as the 
presentation of stimuli to a person result- 
ing in the formation of new S-R mecha- 
nisms, or the elicitation of previously 
acquired S-R mechanisms. Since the dis- 
cussion is limited to certain types of 
verbal communication, either the stimu- 
lus or response involved, or both, will be 
verbal. 

Skinner (1957) has described the 
principle by which a stimulus may come 
to control a response through reinforce- 
ment procedures within the context of 
language (see selection 8 for a helpful 
summary). If a response is reinforced in 
the presence of a stimulus and not in its 
absence the stimulus will come to control 
the response in the sense that when the 
stimulus occurs the response will be more 
likely to occur. The stimulus will become 
what is called a discriminative stimulus, 
or SP, for that response. There are several 
types of SPs that are important in lan- 
guage learning. Environmental stimuli 
become SPs for particular verbal re- 
sponses, Skinner describes these verbal 
mechanisms as tacts. The words of others 
as auditory stimuli become S?s for imi- 
tative vocal responses, and these mecha- 
nisms are called echoics by Skinner. And 
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visually presented verbal stimuli also be- 
come SPs for vocal responses in the acqui- 
sition of a reading repertoire. Skinner de- 
scribes these verbal mechanisms as texts. 
These S-R mechanisms will be further 
described as they function in communica- 
tion. For the moment, however, the 
principle of operant discrimination will 
be used to indicate another type of verbal 
mechanism of importance to communica- 
tion. 


Verbal Stimulus, Motor Response 
Types of Communication 


In addition to the above types of lan- 
guage learning, a child will also be trained 
to make certain non-verbal motor re- 
sponses in the presence of appropriate 
verbal stimuli, either written or auditory. 
Let us say, as an example, that father says 
COME TO ME (an auditory stimulus to 
the child) and when the child responds 
by approaching the father, the father rein- 
forces the child by a hug, a toss into the 
air, or the like. Under this type of train- 
ing the verbal stimulus will become an 
SP for the non-verbal approach behavior. 
Later in the child’s life, as a consequence 
of many instances of this type of training, 
when someone says COME TO ME, the 
child will respond appropriately. This 
latter interaction would be called com- 
munication, both in a popular sense and 
in the definitional counterpart given 
herein. 

It should be added, of course, that in 
any particular situation there will be 
multiple stimulus controls over the child’s 
behavior. If the stimulus, COME TO 
ME, is emitted by an uncle who always 
pinches the child affectionately but pain- 
fully, or restrains the child too long, he 
will also become an SP for “avoidance” 
responses. In this case, COME TO ME 


will not control an approach response. 
This qualification is described now, for 
this and the other cases to be discussed, 
to show that it is not a breakdown in 
communication, or a refutation of the 
principle of stimulus control. In the natu- 
ralistic setting there may be a multitude 
of stimuli which have controlling prop- 
erties over the individual's behavior, and 
the action of a particular controlling 
stimulus may be obscured. To understand 
a behavior we must understand both the 
behavior principles as well as the particu- 
lar history of experience of the organism. 
To continue, however, the generality of 
this type of communication can be de- 
picted with the help of two diagrams. 
Verbal stimuli as shown in Fig. 1 may as 
SPs come to control certain non-verbal 
motor behaviors. Ordinarily, the child 
will acquire a vast repertoire in which 
many diverse verbal stimuli will come to 
control many diverse motor responses. 
For the appropriately trained child, verbal 
stimuli (produced by oneself or another) 
will functionally control in this manner a 
great deal of adjustive behavior. Marked 
distortion, or absence, of this control will 
be viewed as a severe behavior problem. 
In addition to the functional value of 
these controlling verbal mechanisms as 


verbal 
sD 


R 
non-verbal 


FIG. 1. A verbal stimulus can come to 
control a non-verbal motor response 
through operant discrimination learning. 
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controlling mechanisms, on the basis of 
this type of repertoire it will be possible 
for the child to acquire further complex 
skills, That is, new sequences of non- 
verbal motor responses may be acquired 
simply on the basis of verbal instruction 
(i.e., the presentation of auditory verbal 
stimuli), For example, when the chore- 
ographer provides a series of verbal 
stimuli to the expert dancer, each of the 
stimuli will control a particular dance 
movement. In this case, the series of 
verbal stimuli by controlling a series of 
movements, will when repeated result in 
each movement coming to control the 
next to yield a new dance routine. A gen- 
eral example of this important type of 
human learning is depicted in Fig. 2 
where each movement produces a stimu- 
lus which after practice will come to con- 
trol the next response. Many complex 
motor skills are acquired by humans 
through this type of communication. 
Motor responses are controlled at first by 
verbal stimuli but later, after repetition 
and reinforcement, the motor skills come 
under the control of new stimuli—those 
produced by the preceding response. 


Transfer of Operant Control 
from Sign to Sign 


Mowrer discusses communication as 
the transfer of “meanings from sign to 


verbal 
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movement 


movement 
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sign,” that is, the higher-order respondent 
conditioning of a response elicited by one 
word to another word. According to this 
view, a new word could become meaning- 
ful through this process. Let us say that 
the word EVIL is unknown to the child 
and meaningless, although the child has 
been conditioned to respond to the word 
BAD. That is, in the past the child has 
been punished while being told he was 
BAD, thus making BAD a conditioned 
stimulus for various internal responses. 
Now when the child asks what EVIL 
means and is told EVIL MEANS BAD, 
this constitutes a conditioning trial. Each 
time he repeats the phrase he provides an 
additional conditioning trial. In this way 
EVIL will come to elicit the responses 
which BAD already elicits and thus EVIL 
will come in this sense to be meaningful. 
It may also be suggested that an analo- 
gous process takes place upon the basis of 
operant conditioning. Let us say, for ex- 
ample, that the word CLOSE has be- 
come an S? for the child such that it con- 
trols a “closing motor response.” When 


FIG. 2. When a series of verbal stimuli 
are presented, each of which controls a 
particular movement, and this process is 
repeated, the stimuli produced by each 
movement will come to control the next 
movement. In this way a new complex 
movement sequence can be established by 
language means. 


RS ARS 


movement movement 
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SHUT MEANS 
sD 
presented with the verbal stimulus 


CLOSE THE DOOR the child makes 
the appropriate movement. 

Let us also say that the word SHUT 
has never before been presented to the 
child and is, in essence, a nonsense syl- 
lable. It would be expected that if the 
child was told SHUT MEANS CLOSE 
that SHUT would come to control the 
response which CLOSE already controls. 
In the future if the child is told SHUT 
THE DOOR, he will respond appropri- 
ately. This is depicted in Figure 3, 

One further general point may be made 
here. Word meaning has been discussed 
by a number of learning theorists as an 
implicit response which has been respond- 
ently conditioned to the word (Mowrer, 
1954; Osgood, 1953; Staats, 1961). It can 
be added, however, on the basis of the 
above discussion, that a word may be 
meaningful also because it controls an 
operant motor response. Many verbs 
could be considered as meaningful, at 
least in part, in this sense. 


Additional Cases of Operant 
Communication 


At this point we may refer back to the 
other examples of verbal discriminative 
stimuli mentioned at the beginning of 
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FIG. 3. When a word SP which controls a 
motor response is paired in a sentence 
with a meaningless word, in this sense, 
the meaningless word becomes an SP for 
that response. In the example, the new 
word SHUT becomes an SP for the 
closing response through being paired 
with CLOSE in the sentence SHUT 
MEANS CLOSE. 


the present article. There are several addi- 
tional cases of communication which in- 
volve these verbal mechanisms. First, it 
was said that some auditory verbal stimuli 
will come to control echoic (imitative) 
responses. After such a repertoire has 
been acquired it may enter into further 
communication acts. Thus, on the 
simplest level, when an individual in- 
structs the child to say something and the 
child does so, this is a case of communi- 
cation where an auditory verbal stimulus 
controls a vocal response. 

More complex sequences of verbal re- 
sponses may be developed in this man- 
ner, however. Take the child who is told 
to say NOW I LAY and who is then 
reinforced for emitting the sequence. 
When this behavior is strong, let us say, 
the child is told to repeat NOW I LAY 
ME DOWN TO SLEEP and then is 
reinforced—and so on. From this type of 
communication, long sequences of verbal 
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AY ME 


Ae See 


responses may be established. This is de- 
picted in Fig. 4.1 

The same type of communication can 
take place on the basis of reading (or 
texting) where the controlling verbal 
Ss are visually presented. This is also 
true of the other types of communication 
already discussed including the discussion 
by Mowrer (1954). The ability to pro- 
duce various types of communication 
acts constitutes the most important func- 
tions of a reading repertoire. For example, 
when the individual has such a repertoire 
of reading responses to visually presented 
verbal stimuli, new complex verbal se- 
quences can be established through the 
presentation of the verbal stimuli. Much 
learning in school is of this general type, 
for example, the acquisition of an exten- 
sive repertoire of verbal response se- 
quences concerning history from respond- 
ing to a book. In many cases these verbal 
response sequences have no other func- 
tion, and learning is complete when they 
have been established and can be elicited 
under appropriate conditions. 

New complex sequences of non-verbal 
motor responses can also be established 


1 Research which may be considered an 
experimental analogue of this and the next 
type of communication is abundantly 
available in the extensive study of serial 
and paired associate verbal learning. 
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FIG. 4. When a series of verbal stimuli 
are presented each of which controls an 
echoic response (repetition) and the proc- 
ess is completed, that stimuli produced 
by each echoic response will come to 
control the next response. In this way new 
complex verbal response sequences can 
be established. 


from reading. For example, using a previ- 
ous illustration, because the expert 
dancer’s movements have come to be con- 
trolled by appropriate verbal stimuli 
(even when the verbal stimuli are a result 
of his own vocal or sub-vocal responses), 
the dancer can read about a new sequence 
of movements and the verbal response se- 
quence he thus emits can then control a 
new sequence of movements. When re- 
peated the dancer can acquire a new 
routine without personal instruction, or 
the opportunity of observing someone 
else. Because of these many possibilities, 
reading is one of the most powerful forms 
of human learning. 

Finally, I would like to refer again to 
the other type of discriminative stimulus 
control described at the beginning of this 
article and indicate how this may enter 
into acts of communication. It was stated 
that environmental stimuli may come to 
control yocal responses. The child rein- 
forced for saying COW while looking at 
the cow will tend to say COW the next 
time he sees such an animal, Through 
this type of training the child will come 
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to give specific verbal responses to a wide 
number of environmental objects. It 
should also be indicated that complex 
verbal responses also come under the con- 
trol of complex stimuli. Thus, the visual 
stimulus of a boy pulling a girl’s hair will 
come as an SP to control the appropriate 
verbal response sequence of an observing 
child, HE PULLED HER HAIR. 

Based upon such a repertoire, it would 
then be quite possible to establish new 
sequences of verbal responses in a com- 
munication interaction by presenting a 
series of environmental objects to the 
individual. A silent film would be an ex- 
ample of a situation in which a sequence 
of non-verbal environmental stimuli each 
of which controlled verbal responses 
could result in a new complex verbal re- 
sponse sequence—which in this case 
would more or less accurately parallel the 
story of the movie. This may also be con- 
sidered as communication. 

The generality of this type of forma- 
tion of new verbal response sequences can 
be seen by pointing out that the various 
environmental stimuli experienced by an 
individual in his life circumstances would 
be expected to produce characteristic 
verbal response sequences. These aspects 
of an individual's language are thus pro- 
duced by non-verbal stimuli, and in this 
sense the environment, both social and 
physical, “communicates” with the indi- 
vidual. As the author has discussed more 
fully (Staats and Staats, 1963), when the 
environmental stimuli are novel, they may 
produce novel or original verbal responses 
—based upon the individual's already ac- 
quired language repertoire. 


In conclusion, it is not the intention of 
the author in this short article to present 
an exhaustive or detailed discussion of 
the learning mechanisms whose function 
is popularly called communication. The 
article is intended to indicate that the 
term communication applies to various 
verbal interactions that involve diverse 
learning principles and verbal mecha- 
nisms. Perhaps, also, the discussion indi- 
cates how operantly learned language 
mechanisms can function both in con- 
trolling appropriate behavior and in pro- 
ducing new learning for the individual. 
These functions are important products of 
the individual’s language repertoire. Per- 
haps, also, the discussion indicates, follow- 
ing Mowrer’s presentation, that when the 
empirical principles of respondent and 
operant conditioning are integrated, even 
though the formulations derive from dif- 
ferent theoretical orientations, they form 
a more powerful conception with which 
to consider human behavior—in this case 
certain aspects of language function. 
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20. 
Implicit Verbal Chaining in Paired-Associate Learning*’ 


Wallace A. Russell and 
Lowell H. Storms 


The role of covert symbolic processes 
in behavior determination has been em- 
phasized by many psychological theorists, 
but the relative lack of supporting experi- 
mental evidence for this influence has 
been noted by several writers (2; 8, p. 
110), Among the various factors deemed 
relevant to the operation of mediational 
or symbolic processes, the verbal habits 
of the individual have been prominently 
suggested. The work of Foley and Cofer 
(3) on verbally mediated generalization, 
and of Bousfield (1), Jenkins and Russell 
(6), and others working with recall, have 
established that the influence of such 
verbal associations can be studied effec- 
tively under experimental conditions. 


* From W. A. Russell and L. H. Storms, 
Implicit verbal chaining in paired-associate 
learning, J. exp. Psychol., 49, 287-293 
(1955). Reprinted by permission of the 
authors and the American Psychological 
Association. 

1 This study is part of a larger series of 
studies of verbal behavior being conducted 
at the University of Minnesota. The series 
is being sponsored by the Office of Naval 
Research (Contract No. N8 onr-66216) 
under its policy of encouraging basic re- 
search. 


While the mediational role of word as- 
sociations has been demonstrated in sev- 
eral performance situations, there are sur- 
prisingly few studies which report posi- 
tive findings with regard to the effects of 
mediated associations upon learning. 
Bugelski and Scharlock, using paired- 
associate learning and nonsense syllables, 
have provided what they term a “reason- 
ably clear-cut demonstration of mediated 
association in the learning of verbal ma- 
terial” (2, p. 337). Their Ss showed fa- 
cilitated learning of A-C associates when 
another term, B, presumably intervened 
between A and C as a consequence of pre- 
vious learning of associations A-B and B- 
C. The term B, then, provided an implicit 
common term which was elicited by A 
and which in turn tended to elicit C. 
This mediation of the correct response 
C occurred even though Ss did not report 
deliberate use of the common term as a 
mnemonic device. The Bugelski and 
Scharlock data provide a much clearer 
instance of mediation than did the earlier 
experiments of Peters (12). Although the 
latter obtained some positive results, the 
majority of his test situations failed to 
demonstrate mediational effects. 

Both Bugelski and Scharlock and Peters 
worked with associations learned within 
the context of the experiment and neither 
considered situations involving more than 
one intervening term. Nevertheless, appli- 
cations of the mediation hypothesis have 
frequently referred to existing language 
habits and have almost always involved 
reference to a “chain” of several inter- 
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vening terms which are linked on an asso- 
ciative basis. Uni-process theorists who, 
according to Harlow (4, p. 452), main- 
tain that “thinking is dependent only 
upon the formation and appropriate elic- 
itation of a vast number of simple asso- 
ciations” have most commonly assumed 
that (a) mediational effects can occur 
across several intervening terms, and (b) 
these influences are at least as strong for 
associations between real words as be- 
tween nonsense syllables. Hull’s concept 
of pure stimulus acts (5), Miller's exten- 
sion of the notion of verbally mediated 
generalization (10, p. 181), and Osgood's 
discussion of thinking (11, p. 638) are 
but a few examples in which one or the 
other of these assumptions has been 
made. However, neither Peters nor 
Bugelski and Scharlock provide a basis 
for these assumptions. 

The purpose of this experiment was to 
test the adequacy of the above assump- 
tions by observing the effects of mediating 
verbal processes on paired-associate learn- 
ing when the mediating process is imple- 
mented in part by pre-existing language 
habits and extends over more than one 
implicit verbal term. 


tion effects in the learning of A-C associa- 
tions. In the study reported here, real 
words were used rather than nonsense 
syllables, and two implicit terms rather 
than one linked the pairs learned on the 
test trials. Here, the learning of List 1 
established A-B associations. ‘The B term 
was in each case a stimulus word from the 
Kent-Rosanoff association test (7). Re- 
cently obtained norms for responses on 
this test? then made it possible to infer 
certain B-C associations without establish- 
ing them experimentally. Similarly, other 
unpublished studies provided normative 
data concerning the most frequent asso- 
ciative responses (D) made to the C 
terms. Thus, once the A-B associations 
were learned, it was possible to infer an 
associative chain leading from A to B to 
C to D. The test for mediational effects 
was made by requiring Ss to learn a list 
containing A-D pairings and appropriate 
control pairings (A-X) of nonchained 
terms. It was hypothesized that the A-D 
pairings would be learned more easily 
than the A-X pairings. The manner in 
which associative chains might facilitate 
the elicitation and learning of A-D pairs 
is schematically illustrated as follows: 


ASSOCIATIONS INFERRED 


ust l 
Chaining Paradigm A->B, 
Control Paradigm Ap: >By 


Method 


Desicn 


The design of this study was similar to 
that of Bugelski and Scharlock (2). Their 
Ss learned three paired-associate lists: List 
1 established A-B associations; List 2, B-C 
associations; and List 3 tested for media- 


FROM NORMS 


LIST 2 (TEST LIST) 


(B,>C,>D,) Ayre >D, 
(B,>C,)4 
(By>C,>D,) Age etter cites >X, 
A (By>C,>D2) 


2 Revised norms for 100 words from the 
Kent-Rosanoff word-association test were 
obtained from 1008 students in beginning 
psychology classes at the University of 
Minnesota. This work was carried out as 
part of a larger project on verbal behavior. 
Information concerning these norms may 
be obtained from the authors. 


IMPLICIT VERBAL CHAINING 


Broken arrows indicate the association to 
be learned in each list. Solid arrows repre- 
sent associations established before a list 
is learned. It can be seen that associations 
existing before the learning of the test list 
provide an indirect linkage of the A and D 
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terms which must become associated in 
the chaining paradigm. In the control 
paradigm, a similar linkage exists between 
A and D, but no such connection can be 
inferred between the A-X pairs which are 
to be learned. 


TABLE 1 
Associative Frequencies of the Three Most Frequent Responses 
to Ten Kent-Rosanoff Stimulus Words 
(Based on R’s from 1008 Ss) 
SE 


PRIMARY SECONDARY TERTIARY 
STIMULUS R f R f R f 
Stem flower 402 plant 224 leaf 125 
Memory mind 119 remember 99 forget 80 
Soldier army 187 sailor 182 man 101 
Trouble bad 89 shooter 49 worry 45 
Wish want 124 dream 118 desire 112 
Justice peace 250 law 182 courts 163 
Thief steal 286 robber 138 crook 69 
Ocean water 314 sea 233 blue 111 
Command order 196 army 102 obey 78 
Fruit apple 378 vegetable 114 orange 94 
From Russell and Storms: Implicit verbal chaining in paired-associate learning. 

TABLE 2 
Associative Frequencies of the Three Most Frequent Responses 
to Ten Primary Responses to Kent-Rosanoff Stimulus Words 
(Based on R’s from 100 Ss) 
PRIMARY SECONDARY TERTIARY 
WORD R f R f R f 
Flower smell 15 rose 12 ee 12 
thin! 
Mind brain 15 matter 14 ai } 12 
ldi 

Army navy 39 service 7 yar g 
Bad good 71 evil 4 mean 3 
Want need 27 desire 19 have 8 
Peace war 42 dove 10 quiet 8 
Steal take 14 thief 10 rob 8 
Water drink 19 thirsty 14 wet 11 
Order disorder 14 command 6 stop 5 
Apple tree 16 red 14 orange 13 


From Russell and Storms: Implicit verbal chaining in paired-associate learning. 
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CONSTRUCTION OF Parrep-AssociaTe Lists 


Tables 1 and 2 contain the associative 
frequencies from the norms? for the three 
most frequent responses to the words rele- 
vant to this experiment. Table 1 provides 
this information for the ten Kent-Rosanoff 
stimulus words employed and Table 2 
provides analogous data for the most fre- 
quent responses to those ten words. 

Table 3 contains the nonsense syllables, 
the particular associative chains, and the 
control words used throughout the experi- 
ment. List 1 (A-B pairings) was made up 
of the nonsense syllables in Column A 
and the corresponding words in Column B. 
Columns B, C, and D list the verbal asso- 
ciative chains (B  C > D) derived from 
the normative tables. Two test lists were 
formed. One combined the first five non- 
sense syllables of Column A with the five 
corresponding words of Column D and 
the last five nonsense syllables with the 
corresponding words of Column X. The 
other combined the first five nonsense 
syllables in Column A with the five corre- 
sponding words of Column X and the 
last five nonsense syllables with the five 
corresponding words of Column D. Thus 
the two lists were counterbalanced and 
each contained five A-D and five A-X pairs. 
The response words of Form 1 of the test 
list are followed by a “1” in the table; the 
remaining words made up Form 2. 

The ten nonsense syllables of Column 
A were selected from Melton (9), and all 
had Glaze association values of 0%. The 
ten verbal chains listed in Columns B, C, 
and D of the table were selected so that 
as far as the complete norms would indi- 


3 See footnote 2. 


cate, no word in any chain appeared 
among the ten most frequent responses to 
any word in any other chain. In addition, 
no final word (D) in a chain appeared as 
a response to the first word (B) more 
than seven times in the 1008 responses to 
that word in the norms. It may be noted 
that while Column C is essential to the 
construction of the ten associative chains, 
no words in that column appeared in any 
of the experimental lists. The control 
words in Column X were chosen from 
the Kent-Rosanoff list such that none ap- 
peared among the ten most frequent re- 
sponses to any of the chained words and 
no chained word appeared among the ten 
most frequent responses to a control 
word. Finally, the control words were 
matched with the final words of each 
chain on the basis of Thorndike-Lorge 
(13) frequency as a partial equalization of 
difficulty between control and experi- 
mental words. 


PROCEDURE 


Twenty-seven sophomore women from 
a beginning psychology class served as Ss. 

Following general instructions on 
paired-associate learning, each S learned 
List 1 on a standard Hull-type memory 
drum. Each stimulus word was exposed 
for 2 sec. before the response word ap- 
peared beside it for another 2-sec. period. 
The next stimulus word followed im- 
mediately, except that 4 sec. elapsed after 
each complete trial through the list. The 
S was required to learn the ten pairs in 
List 1 to a criterion of three consecutive 
trials in which all response words were 
correctly anticipated. To control for serial 
position effects, the list was presented in 
three successive random orders of pairs 
before the first order was repeated. Three 
Ss failed to reach the criterion on List 1 
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TABLE 3 


Nonsense Syllables, Associative Chains, and Control Words Used 
in Forming the Paired-Associate Lists 


A B Cc D x 

NON- FIRST SECOND FINAL 

SENSE CHAINED CHAINED CHAINED CONTROL 
SYLLABLE WORD WORD WORD WORD 

Cef stem flower smell (1) joy 

Dax memory mind matter (1) afraid 

Yov soldier army navy (1) cheese 

Vux trouble bad good (1) music 

Wub wish want need (1) table 

Gex justice peace war house (1) 

Jid thief steal take sleep (1) 

Zil ocean water drink doctor (1) 

Laj command order disorder cabbage (1) 

Myv fruit apple red hand (1) 


Note. The words and syllables were presented in capital letters exactly as above. The 


response words of Form 1 of the test list are followed by a “1.” 
Frorh Russell and Storms: Implicit verbal chaining in paired-associate learning. 


within 40 min. and were not used further 
in the experiment. 

After a pause of 4 min., each remaining 
S was presented with either Form 1 or 
Form 2 of the test list. The Ss were in- 
structed that the procedure was exactly 
the same as for List 1 and were urged to 
do their best on the test list. Since one S 
failed to reach the criterion of one trial in 
which all the response words were cor- 
rectly anticipated, there remained 23 Ss 
for the final analysis of results. Twelve of 
these learned Form 1 of the test list and 
11 learned Form 2. 

For each S, all correct anticipations and 
errors were tabulated for both List 1 and 
the test list. Measures used in the final 
analysis were: (a) the number of trials 
required to reach the criterion on List 1; 
(b) the number of mediated (D) and 
unmediated (X) responses occurring in 
the first five different correct anticipations 


by each S; (c) the total number of correct 
responses made for the mediated (D) and 
unmediated (X) words during the test 
trials. 


CONTROL EXPERIMENT 


Twelve additional female Ss from the 
same population were used in a subse- 
quently performed control experiment de- 
signed to allow a comparison of the learn- 
ing of A-D and A-X pairs in a situation 
where associative chaining could not dif- 
ferentially contribute to the learning of 
the pairs. Instead of learning List 1, these 
Ss first learned either Form 1 or Form 2 
of the test list. The second list was the 
other form of the test list. Thus, in the 
control experiment, associative facilitation 
due to A> B > C > D linkages was not 
possible because the A-B associations of 
List 1 were not learned by any S. The 
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analysis of results for the contro] Ss was 
based on measures similar to those of the 
main experiment. 


Results 


Since two forms of the test list and two 
groups of Ss were involved in the design, 
the equivalence of the two lists and the 
two groups must be established before 
the combined results can be dealt with. 
An analysis of the mean number of trials 
required to reach the criterion of learning 
on List 1, which all Ss learned, indicated 
that the 12 Ss who subsequently learned 
Form 1 of the test list did not differ sig- 
nificantly (t =.52) from the 11 Ss who 
subsequently learned Form 2 of the test 
list. The mean for the former group was 
25.00 (SD = 9.17); for the latter it was 
22.91 (SD = 9.30). With respect to per- 
formance on the two forms of the test 
list, the mean number of correct anticipa- 
tions per S during learning did not differ 
significantly between Forms 1 and 2. The 
means for Forms | and 2 were, respec- 
tively, 67.08 (SD = 30.75) and 58.09 
(SD = 17.04). The Behrens-Fisher d of 
.87 did not allow rejection of the null 
hypothesis concerning form differences. 

As a consequence of these comparisons, 
the results from Forms 1 and 2 of the test 
list were combined. In order to determine 
whether the response terms for A-D pairs, 
for which associative chaining was pos- 
sible, were more easily elicited during the 
early trials, an analysis was made of the 
first five different correct responses made 
by each S. Of the 115 responses in this 
analysis, 67 were members of “chained” 
A-D pairs and 48 were from “unchained” 
A-X pairs. The normal curve approxima- 
tion to the binomial indicates that a re- 
sult this large and in this direction would 


occur by chance less than 4 times in 100 
if the probabilities of successes for A-D 
and A-X pairs were equal. Of the 23 Ss in 
this part of the experiment, 19 showed 
more chained than unchained responses 
in their first five different correct re- 
sponses. The same one-tailed binomial 
test indicated that this result would occur 
by chance only 1 time in 1000 if the 
probabilities of successes for all pairs were 
equal, The conclusion that chained words 
were more easily elicited during the early 
trials of learning seemed warranted. 

The major purpose of the experiment, 
however, was to compare the ease with 
which chained and unchained pairs were 
learned. The design allowed this com- 
parison to be made with each S acting as 
her own control. Since each S learned an 
equal number of chained (A-D) and un- 
chained (A-X) pairs, the total number of 
correct anticipations by each § for the 
unchained pairs was subtracted from the 
corresponding total for chained pairs. If 
there is facilitation of the learning of 
chained pairs (i.e, S has a larger number 
of correct anticipations on the A-D than 
on the A-X pairs) this difference will be 
positive. Over all Ss the mean difference 
between chained and unchained pairs was 
3.74 (SD = 5.32). A t of 3.30 (.01 > p > 
001) leads to rejection of the null hy- 
pothesis, and the conclusion that there 
was facilitation of learning of A-D pairs 
as contrasted with the learning of A-X 
pairs. 

A secondary analysis of performance on 
Form 1 and Form 2 separately revealed 
that the direction of the difference be- 
tween chained and unchained pairs was 
positive for both forms (Form 1, M= 
+4.92, SD = 5.85; Form 2, M = +2.45, 
SD = 4.31). For Form 1, the t of 2.79 
was significant at the .02 level of confi- 
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dence. For Form 2, the t of 1.80 was be- 
tween the .15 and .10 levels. 

It was recognized that, if for reasons 
other than associative chaining, the A-D 
pairs were as a group intrinsically easier to 
learn than the A-X pairs, the results ob- 
tained here could be accounted for on the 
basis of that factor alone. The control 
study was run to provide information 
about the relative difficulty of A-D and 
A-X pairs in a situation where chaining 
of A-D pairs was not possible. The 12 Ss 
in the control experiment learned both 
Forms | and 2 of the test list. The per- 
formance of these Ss on whichever form 
was learned last provided the basis for 
the analysis of the control experiment. 
First, the mean number of correct antici- 
pations of the response word was deter- 
mined for the ten A-D and the ten A-X 
pairs. The means were 7.06 and 7.35 re- 
spectively, with SD’s of 1.29 and 1.39. 
This difference did not approach signifi- 
cance and the direction of difference is 
unfavorable to the hypothesis that the 
A-D pairs were easier to learn than the 
A-X pairs. Finally, the two major analyses 
of the main experiment were repeated 
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here. As Table 4 indicates, neither of the 
differences tested was significant, and in 
each case the direction of difference did 
not favor the A-D pairs. In the absence of 
the possibility of associative chaining, 
then, there was no evidence of easier 
learning of the A-D pairs used in this ex- 
periment. 


DISCUSSION 


Statistically, these results provide 
stronger evidence for mediational effects 
in learning than do the results of Bugelski 
and Scharlock (2). This is true in spite 
of the fact that the present experiment 
involves one more step in the chain of 
associations mediating the facilitated 
learning. Instead of an A-B-C sequence 
contributing to the learning of A-C, an 
A-B-C-D chain contributed to the learn- 
ing of A-D. This demonstration of media- 
tional influences extending over more 
than one intervening term, and involving 
language habits established prior to the 
experiment, offers some confirmation for 
theoretical explanations of thinking, prob- 
lem solving, etc., which have postulated 


TABLE 4 
Summary of Major Results 


INITIAL SUCCESSFUL 
ANTICIPATIONS (FIRST 5 
DIFFERENT CORRECT R’S 


TOTAL CORRECT 
RESPONSES: MEAN 
OF CHAINED MINUS 


FOR EACH S) UNCHAINED 
SIGNIFI- 
CANCE OF 
EXPERI- UN- DIFFER- SIGNIFI- 
MENT CHAINED CHAINED ENCE (3) CANCE 
Main 67 48 04 +3.74 01 
Control 30 30 —0.50 


From Russell and Storms: Implicit verbal chaining in paired-associate learning. 
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the operation of such complex implicit 
associative sequences. . . . 

The fact that questions following the 
experiment yielded no evidence that Ss 
could verbalize the mediating terms only 
emphasizes the Bugelski-Scharlock con- 
clusion that mediated association may be 
“unconscious.” 


SUMMARY 


This experiment was designed to study 
the effects of mediating verbal processes 
on paired-associate learning when the 
mediating process is implemented in part 
by pre-existing language habits and ex- 
tends over more than one implicit verbal 
term. 

First, ten chains of word associations, 
B-C-D, were constructed from normative 
data on association frequencies. Twenty- 
three female college Ss then learned a list 
of A-B pairs where the A terms were non- 
sense syllables and the B terms were the 
initial members of the chains described 
above. The test situation required that Ss 
learn another list consisting of A-D and 
A-X pairs. The D terms were the final 
members of the associative word chains, 
and the X terms were not associated with 
any of the chains. A control experiment 
revealed that the A-D and A-X pairs did 
not differ in difficulty in the absence of 
chaining possibilities. 

It was found that the A-D pairs were 
learned significantly faster, and elicited 
earlier in learning, than the A-X pairs. It 
was concluded that implicit verbal chains 
of more than one link mediated these 
effects. Reasons for these results being 
even more clear-cut than those of sche- 
matically simpler previous experiments 
were discussed. 
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zis 
Conditioned Stimuli, Conditioned Reinforcers, 
and Word Meaning*’ 


Arthur W. Staats 


In psychology, in various areas, there 
has been a tendency towards separatism 
—not only between major schools of 
thought, but also within these divisions. 
As a consequence there is a correlated 
tendency for an investigator influenced 
by one approach to generally eschew the 
other, and each continues his activities 
largely in ignorance of the other. Separate 
terminologies have occurred which tend 
to prevent the integration of findings 
made in the separated fields. Thus, for 
example, in the field of a learning ap- 
proach to language, there are several 
largely isolated endeavors. There are those 
interested in verbal learning which pri- 
marily involves the principles and proce- 
dures of serial and paired associate learn- 
ing. Then there are those who are inter- 
ested in the semantic properties of words 
in terms of respondent conditioning prin- 
ciples. And there are those whose interest 


* From A, W, Staats, Conditioned stimuli, 
conditioned reinforcers, and word mean- 
ing, Technical Report No. 27, Contract 
No. Nonr-2794(02) between the Office of 
Naval Research and Arizona State Uni- 
versity, February 1964. 


is in the operant conditioning of verbal 
behavior. 

For the most part, these works have re- 
mained largely uncontaminated by one 
another, although in each case the investi- 
gations spring from learning principles. 
It may be suggested, however, that one 
of the tasks of a learning approach to 
psychology is to integrate its principles 
into a coherent framework with which to 
incorporate the diverse empirical findings 
within the field as well as findings outside 
of the field of learning. The present au- 
thor has attempted an integration in vari- 
ous areas of language learning (Staats, 
1961, 1963, 1964a; Staats and Staats, 
1963), and the present paper will discuss 
additional possibilities of this type. 

More specifically, consideration of the 
operations involved suggests that condi- 
tioned stimuli and conditioned reinforcers 
develop according to the same principles. 
And this has implications for understand- 
ing certain aspects of language develop- 
ment and function. 


Conditioned Stimuli and 
Conditioned Reinforcers 


Originally, within the operant condi- 
tioning approach, conditioned reinforcers 
were considered to be formed in a proce- 
dure of operant discrimination. The proc- 
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ess was not considered in terms of re- 
spondent conditioning principles. For 
example, Keller and Schoenfeld (1950) 
stated the following. “From the view- 
point of procedure, the training condi- 
tions for obtaining an S” are the same as 
those for obtaining an S?, We must first 
make an S? of the stimulus we wish to 
use later as an S” (1950, p. 236). 

More recently, investigators of an oper- 
ant orientation have begun to recognize 
that S's are formed in respondent condi- 
tioning procedures. For example, Kelleher 
and Gollub in a review of the literature 
on positive conditioned reinforcement 
state the following. “A stimulus repeat- 
edly presented just before a primary rein- 
forcer can acquire reinforcing properties. 
Operationally, this procedure resembles 
the respondent conditioning procedure; 
that is, the presentation of the primary 
reinforcing stimulus is contingent upon 
the presentation of the conditioned rein- 
forcer rather than upon a_ response” 
(1962, p. 545). (Nothing is said, how- 
ever, of the possibility that the stimulus 
owes its acquired reinforcing function to 
the fact that as a CS it has come to elicit 
a conditioned response.) 

This change in interpretation of the 
procedures involved in establishing a 
stimulus as a conditioned reinforcer con- 
stitutes a swing back towards the view of 
Clark Hull as set forth in Principles of 
Behavior (1943), Although Hull did not 
distinguish between operant and respond- 
ent conditioning, he suggested that the 
procedure of classical (respondent) con- 
ditioning, in which a neutral stimulus is 
paired with a stimulus which elicits a 
response, produced two results. First, the 
neutral stimulus would come to elicit the 
response (or part of it), that is, become 
a conditioned stimulus (CS). In addition, 
Hull stated that such a conditioned stimu- 


lus would then be able to reinforce a 
response in an operant sense. That is, ac- 
cording to present day conceptions, a 
stimulus which had become a CS and 
would elicit some conditioned response, 
would by virtue of this process also have 
acquired an operant reinforcing function. 
This could be shown by presenting the 
stimulus following a response in which 
case the frequency of occurrence of the 
response would increase. A stimulus 
which has acquired such reinforcing value 
was called a secondary reinforcer, or con- 
ditioned reinforcer (S"). 

Hull was very clear in suggesting that 
the ability of the stimulus to serve as a 
conditioned reinforcer depended upon the 
stimulus being a CS for the conditioned 
response. “Stimuli which acquire second- 
ary reinforcing power seem always to ac- 
quire at the same time a conditioned 
tendency to evoke an associated reaction. 
The available evidence indicates that as 
such stimuli lose through extinction the 
power of evoking this reaction, they lose 
in about the same proportion their power 
of secondary reinforcement. It is probable 
also that the reverse is true; that a stimu- 
lus gradually acquires its powers of sec- 
ondary reinforcement as it acquires the 
power of evoking the reaction conditioned 
to it” (p. 98). Mowrer (1960) has also 
made an essentially similar analysis. 

This view is supported by the fact that 
intermittent conditioning procedures pro- 
duce CS which are more resistant to ex- 
tinction (e.g., Grant, D. A. and Schipper, 
L. M., 1952), as well as Sts that are more 
resistant to extinction (Zimmerman, 
1957). That is, an acquisition variable 
effects in the same manner this measure 
of the strength for both. It might also be 
expected that number of conditioning 
trials, time between CS and UCS, and 
so on, which effect the strength of a CS, 
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would also effect in a like manner the 
strength of an S”. 

Hull also pointed out that higher-order 
conditioning of reinforcers should also be 
capable of occurring. This is a derivation 
from the principles of respondent condi- 
tioning. That is, using the present termi- 
nology, after a stimulus becomes a CS for 
a response, the CS can be paired with a 
new stimulus and the new stimulus will 
also become a CS for the response. By 
the same process, a new stimulus which 
is paired with a CS which is also a condi- 
tioned reinforcer (S") should also become 
a conditioned reinforcer as it becomes a 
CS. As will later be described, the exten- 
sion of the principle of higher-order con- 
ditioning to the formation of conditioned 
reinforcers is one of the important aspects 
of an analysis which treats conditioned 
reinforcement in terms of respondent 
conditioning principles. 

It might be suggested here that it 
would have an integrating effect, as well 
as a heuristic effect, for a convention to 
be established which would more effec- 
tively indicate the relationship of the CS 
and S” properties of a stimulus. As a func- 
tion of pairing a stimulus with a UCS, 
the stimulus comes to elicit a conditioned 
response, and for this reason is called a 
conditioned stimulus, or CS. If, as a func- 
tion of becoming a conditioned stimulus, 
the stimulus also acquires reinforcing 
value, a designation for this added prop- 
erty should be affixed to abbreviate the 
term conditioned reinforcing stimulus as 
Csr, 

It should also be pointed out, that not 
all UCS may be considered to be rein- 
forcers, although they serve to elicit some 
response on an unlearned basis. Thus, a 
flash of light elicits a pupil contraction 
which can be conditioned, but the flash 
of light may be quite neutral, or almost 
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so, in terms of reinforcing value. A tap to 
the knee may elicit a knee jerk while hav- 
ing little reinforcement value. Thus, UCS 
could be expected to vary in reinforce- 
ment value—some being either positive 
or negative in differing degrees, and some 
being neutral. To follow the convention 
already suggested for conditioned stimuli, 
it would seem appropriate to designate 
UCS which have reinforcing value as 
UCS®, and those which do not simply as 
UCS. A neutral stimulus paired with a 
UCS would be expected to become a CS 
but not a CS’, 

This analysis may be considered the 
basic theory. The rest of the paper will be 
concerned with matters within the area of 
language development and function 
which derive from the analysis and which 
bear upon it. 


Word Meaning and Conditioned 
Reinforcement Value 


The contemporary behavioral concep- 
tion of word meaning has its roots in 
Hullian formulations (Hull, 1930) as 
they were extended to the area of lan- 
guage by Osgood (1953). Although Os- 
good, following Hull, labels his analysis 
as a reinforcement approach, the model 
applied to the development of word 
meaning, when considered in terms of 
procedures, actually involves respondent 
conditioning. And it has been treated in 
this manner by later theorists (Mowrer, 
1954; Staats, 1961). 

According to this view, in the develop- 
ment of word meaning, a word is a condi- 
tioned stimulus and the meaning is a con- 
ditioned response. The word (CS) comes 
to elicit this conditioned response by be- 
ing paired with a stimulus object (UCS) 
which already elicits the response. Natu- 
ralistic observation indicates there is am- 
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ple opportunity for such conditioning to 
occur—many words are systematically 
paired with certain other stimulus events 
and should come to elicit parts of the re- 
sponses elicited by these stimuli. 

Furthermore, there are experimental 
results which support the relevance of the 
application of respondent conditioning 
principles to the study of the develop- 
ment of word meaning (Staats, Staats, 
and Crawford, 1962). In this study, a 
word (LARGE) was paired as a CS with 
aversive stimuli (either electric shock or 
a loud noise) 9 out of the 14 times the 
word was presented in a list of words the 
subjects were ostensibly to learn. After 
this treatment it was found that the CS- 
word had acquired a negative meaning. 
That is, the subjects, in comparison to a 
control group of subjects, rated the mean- 
ing of the word toward the unpleasant 
pole of a 7-point pleasant-unpleasant 
scale. The meaning had been conditioned 
to a word by means of respondent condi- 
tioning procedures. 

In addition, during the experiment the 
subjects’ galvanic skin response (GSR) 
to the CS-word was also recorded. It was 
found that in the conditioning procedure 
that the CS-word had come to elicit the 
GSR as a result of having been paired 
with the UCS (shock and noise) for this 
response. Moreover, the extent of the 
conditioning of the GSR was found to be 
positively correlated with the extent of 
the conditioning of the meaning of the 
CS-word. This finding also supports the 
treatment of meaning as a respondently 
conditioned response, and suggests that 
the GSR and meaning conditioning were 
parallel processes—if not the same proc- 
ess. 

If word meaning is respondently condi- 
tioned, however, it would also be expected 
that higher-order conditioning of mean- 


ing would occur. In higher-order condi- 
tioning a stimulus which was formerly a 
CS is used as the UCS in conditioning 
a response to yet a new stimulus. Thus, 
in the example above, the word LARGE 
after having come to elicit the negative 
meaning response could be paired with 
another neutral word. It would be ex- 
pected this would make the new word 
also elicit a negative meaning. 

Based upon this rationale, the present 
author developed an experimental method 
with which to further study word mean- 
ing. In the method, a meaningless verbal 
stimulus (CS) was paired one time each 
with a set of words (UCS) each of which 
already elicited a type of meaning. The 
CS-verbal stimulus as a consequence of 
this procedure should acquire the mean- 
ing of the UCS-words, which is what 
occurred. The use of this method in a 
series of studies has indicated that word 
meaning appears to be capable of higher- 
order conditioning (eg., Staats and 
Staats, 1957; Staats, Staats, and Heard, 
1961). 

As the principle of higher-order condi- 
tioning would suggest, it should also be 
possible for words that elicit evaluative 
meaning to be paired with stimulus ob- 
jects, thus conditioning the evaluative 
meaning to the objects. This process has 
been shown in a study by Di Vesta and 
Stover (1963). First, nonsense syllables 
were made CS for evaluative meaning 
using the higher-order conditioning pro- 
cedure described above. Then stimulus 
objects were labeled by the nonsense syl- 
lables. It was found that the objects had 
acquired the evaluative meaning of their 
labels. 

If word meaning of this type is a con- 
ditioned response, then additional princi- 
ples should also hold. For example, a 
greater number of conditioning trials 
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should produce greater conditioning. This 
has been shown (Staats, and Staats, 
1959) in a study in which the CS-word 
was paired a different number of times 
with words having a particular meaning 
in the procedure described above. The 
greater the number of conditioning trials, 
the more strongly was the meaning con- 
ditioned. It has also been shown (Staats 
and Staats, 1960) that intermittent pair- 
ing of a CS verbal stimulus with UCS 
words produces less intense conditioning 
than does continuous pairing, as would be 
expected from basic studies of respondent 
conditioning (see Ross, 1959). 

Thus, it appears appropriate to con- 
sider the development and transfer of 
word meaning in terms of respondent 
conditioning principles. This account, 
however, does not indicate the import of 
the development of word meaning, What, 
one may ask, is the function of words 
that have acquired meaning? The follow- 
ing discussion will be concerned with one 
aspect of the function of meaningful 
words, in particular, with words that have 
evaluative meaning as defined by Osgood 
(Osgood, Tannenbaum, and Suci, 1957). 

In the previous section of this paper it 
was suggested that a stimulus as it be- 
comes a CS for a response will in some 
cases also become a conditioned rein- 
forcer, CS", This second function will be 
acquired when the unconditioned stimu- 
lus is a type which would be termed a 
primary reinforcer or UCS”. Having dis- 
cussed word meaning in terms of re- 
spondent conditioning, it would be ex- 
pected from the preceding analysis that a 
CS-word that had come to elicit a certain 
type of meaning response would also by 
the same process have become a condi- 
tioned reinforcer. 

For example, in the study previously 
mentioned in which the word LARGE 
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was paired with electric shock and noise 
as the UCS, LARGE became a CS for 
an “unpleasant” meaning response and a 
galvanic skin response. Since the uncon- 
ditioned stimuli used were primary nega- 
tive reinforcers, however, it would also be 
expected that LARGE would have be- 
come a conditioned negative reinforcer 
and, to the extent of this effect should 
function as such. That is, if the word was 
presented contingent upon a response it 
should decrease the strength of that re- 
sponse. Or if the word was withdrawn 
following a response, this should increase 
the strength of the response. 

The above suggests that a stimulus 
word which has negative evaluative mean- 
ing will function as a negative reinforcer. 
The same suggestion is given for the re- 
lationship between positive evaluative 
meaning and positive reinforcement value 
by a study of Schutz and Naumoff 
(1963). These investigators have shown 
that a meaningless verbal stimulus (non- 
sense syllable) when used as a CS and 
paired with a UCS that is a positive re- 
inforcer (money) will acquire positive 
evaluative meaning as measured by se- 
mantic differential rating scales, Exten- 
sion of the principle by which condi- 
tioned reinforcers are established would 
also lead to the expectation in this study 
that the verbal stimulus would at the 
same time have acquired positive rein- 
forcement value. 

Thus, in general, it would be expected 
that words which are rated on the type 
of seven-point scale used in these studies, 
either at the positive (pleasant) pole or 
at the negative (unpleasant) end, should 
function as positive or negative rein- 
forcers. And, there are many words which 
fall into one of these two categories. In 
studies which use these 7-point rating 
scales, called semantic differentials, Os- 
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good and associates (Osgood, Suci, and 
Tannenbaum, 1957; Triandis and Os- 
good, 1958) have shown that one of the 
important and universal ways that word 
meaning can vary is in its evaluative di- 
mension. 

Naturalistic evidence also supports the 
contention that words which have evalua- 
tive meaning actually function as rein- 
forcing stimuli, both as positive and nega- 
tive reinforcers. That is, people seem to 
do many things to “escape” negative 
meaning words, while positive meaning 
words appear to strengthen and maintain 
behavior which they follow. 

Moreover, there are several types of ex- 
perimental evidence which support the 
preceding analysis of the relationship of 
evaluative word meaning and reinforce- 
ment value, as well as the more basic 
analysis of the relationship of conditioned 
stimuli and conditioned reinforcers, First, 
a number of studies (see Krasner, 1958) 
have shown that words which have posi- 
tive evaluative meaning, for example the 
words GOOD and FINE, when applied 
contingent upon a class of verbal re- 
sponses will increase the frequency of 
emission of those responses. Thus, these 
words of positive evaluative meaning 
have been shown to function as rein- 
forcers. 

Portnoy and Salzinger (in press) had 
verbs rated on semantic differential scales, 
obtaining classes of words with positive, 
negative, and neutral evaluative meaning. 
These words were found to be in a re- 
sponse class susceptible to operant con- 
ditioning in a procedure in which one 
word of each class was presented to the 
subject on a card along with 3 personal 
pronouns. The subject had to choose one 
of the verbs and a pronoun and construct 
a sentence. All of the positive, negative, 
and neutral verbs were presented this way 


and the class of verbs selected was later 
manipulated by the experimenter de- 
pending upon which class was reinforced. 
Of interest to the present discussion, how- 
ever, is the fact that prior to the institu- 
tion of reinforcement for choosing one 
of the verb classes (the pre-conditioning 
period), subjects selected positive mean- 
ing verbs more frequently than the neu- 
tral or negative ones. Portnoy and Sal- 
zinger suggest that this indicates that 
““good’ verbal responses have in the his- 
tory of these Ss been associated with posi- 
tive reinforcement and therefore have 
acquired positively reinforcing properties 
themselves” (p. 6). 

Furthermore, based upon the previ- 
ously presented rationale that positive and 
negative evaluative meaning words should 
function as reinforcers, a study (Finley 
and Staats, 1964) has been conducted in 
which words with evaluative meaning 
were presented contingent upon a re- 
sponse and the effect upon the frequency 
of emission of the response was assessed. 
The study was conducted as follows. A 
group of positive evaluative meaning 
words, a group of negative evaluative 
meaning words, and a group of words 
without evaluative meaning were selected 
on the basis of semantic differential rat- 
ings of 6th grade children. Then other 
6th grade children were used as subjects 
in a situation where the task was to press 
either a right-hand button or a left-hand 
button when a light in front of the sub- 
ject was illuminated. After a pre-condi- 
tioning period to tabulate the frequency 
of the two responses, the positive, nega- 
tive, or non-evaluative meaning words 
were presented contingent upon each left- 
hand response. For one group of subjects 
each left-hand response occasioned the 
auditory presentation of a positive mean- 
ing word, for another group a negative 
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meaning word, and for a third group a 
non-evaluative meaning word. Over 6 
blocks of 10 trials (the first block was 
pre-conditioning) of making one or the 
other response, the subjects increased in 
their rate of emission of the left-hand re- 
sponse when the response was followed 
by positive evaluative meaning words. 
When the negative evaluative meaning 
words were presented contingent upon 
the response, the response decreased in 
frequency. The words without evaluative 
meaning, although they were meaningful 
in other ways, did not systematically in- 
crease or decrease the strength of the 
response. 

The results showed that words with 
positive evaluative meaning function as 
positive reinforcers, words with negative 
evaluative meaning function as negative 
reinforcers, and words without evaluative 
meaning, although otherwise meaningful, 
do not function as reinforcers. In the 
light of the previous treatment of word 
meaning as respondently conditioned, 
these results support Hull’s contention 
that conditioned reinforcement value is 
respondently conditioned and that it de- 
pends upon the conditioned response. 
Furthermore, the experiment helps inte- 
grate the study of word meaning and the 
semantic rating of words with the princi- 
ples and findings of operant condition- 
ing. It also suggests that semantic differ- 
ential rating scales can be used to 
measure the reinforcement value of stim- 
uli, that is, the extent to which stimuli 
will shape and maintain human behavior. 
This suggestion has a good deal of sig- 
nificance since the study of psychological 
measurement, as one example, concerns 
to a large extent the assessment of the 
reinforcing value of stimuli, as in tests of 
interests, values, attitudes, and person- 
ality. 
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SUMMARY AND CONCLUSIONS 


It has been suggested herein, that some 
UCS are also primary reinforcers, or 
UCS®?. When this is the case, following 
Hull’s original analysis, the response 
elicited by the UCS” will be conditioned 
to any neutral stimulus with which the 
UCS? is paired. In that case the neutral 
stimulus will become a CS in the sense 
that it will now elicit the response. In 
addition, as a consequence of this condi- 
tioning, the neutral stimulus will acquire 
the reinforcement value of the UCS*, 
thus becoming a CS”. Higher-order condi- 
tioning of these eliciting and reinforcing 
properties can also occur from a CS” to a 
new neutral stimulus. 

In the area of language, extension of 
these principles suggests that words may 
become conditioned eliciting stimuli 
(CS), and as a consequence will also be 
conditioned reinforcing stimuli (CS). It 
has also been suggested that measures of 
evaluative word meaning, which have 
been referred to the eliciting property of 
words, also give indications of reinforcing 
value. Several sources of empirical sup- 
port for these expectations were de- 
scribed. 

There are implications of this analysis 
which indicate that it has import besides 
the establishment of economical termino- 
logical conventions within the language 
of a science. On its most general level, a 
vital aspect of human behavior involves 
the stimuli which are reinforcing for the 
individual, This is a primary concern of 
the field of human motivation. And, the 
manner in which humans vary in this 
respect, and these variations are large, de- 
pends upon differences in conditioned re- 
inforcers. Many of the stimuli which 
shape and maintain human behavior 
through their reinforcing function are not 
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primary reinforcers such as food, water, 
tactual stimuli (as in sexual contact), 
warmth, and so on. Human motivational 
stimuli are largely learned. For this rea- 
son, understanding the principles of the 
formation and function of conditioned 
reinforcers is important. Furthermore, 
since many of these conditioned rein- 
forcers are verbal, and the procedures for 
creating new conditioned reinforcers are 
often based upon other word reinforcers, 
it is necessary to understand the way in 
which the basic principles apply to lan- 
guage. 

A few cursory examples may serve to 
illustrate some of the areas of application 
of these statements. In the area of clinical 
psychology, respondent conditioning tech- 
niques (see Eysenck, 1960) have been 
used for some time in aversion therapy. 
Thus, alcohol as a CS may be paired with 
electric shock, Although the procedure is 
respondent conditioning, it is the change 
in reinforcing value of the stimulus that 
is important, that turns the patient’s “ap- 
proach” response to one of “escape.” Ex- 
plicit realization of the two principles 
involved might be expected to yield more 
precise knowledge of the procedures and 
their effects. 

In addition, verbal psychotherapy can 
be seen, in the light of the preceding dis- 
cussion, to involve respondent condition- 
ing procedures in which words as CS are 
used to change the reinforcing value of 
other words and objects important in the 
patient’s life. The change in reinforcing 
value then effects the patient’s behavior. 
Abnormal behavior has been considered 
by the present author (Staats and Staats, 
1963) in terms of the unusual develop- 
ment of such conditioned reinforcers. 

In social psychology, attitude forma- 
tion can be considered to involve the de- 
velopment and function of conditioned 
reinforcers. And the study of group co- 


hesiveness is the study of the (respond- 
ent) principles by which people in a 
group as stimuli for each other acquire 
reinforcement value by verbal and non- 
verbal conditioning (see Lott and Lott, 
1960), as well as the study of the (oper- 
ant) principles by which group member 
behavior is affected. 

In educational psychology, a primary 
concern of educators with the motivation 
of children may be considered within the 
principles that have been presented. For 
example, the stimuli produced by learn- 
ing itself must become a reinforcer if the 
pupil’s attention and studying behavior is 
to be maintained in the classroom situa- 
tion. Other important sources of condi- 
tioned reinforcers are the approval of the 
teacher, parents, siblings, and school- 
mates (see Staats and Staats, 1963), Un- 
derstanding the principles by which rein- 
forcers are formed and by which they 
effect pupil’s behavior is central to the 
treatment of many educational problems. 
(In this and the other examples, other 
articles in the present book will make 
further elaborations of these sugges- 
tions. ) 
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22. 
Verbal Mechanisms in Purpose and Set*’ 


Arthur W. Staats 


Russell has very well posed the difficult 
problems in dealing with “purpose” and 
“set” within an objective framework. The 
conceptual and experimental difficulties 
are described, and alternative strategies 
are presented. This effort should rekindle 
interest in these areas of complex human 
behavior and should stimulate experi- 
mental or conceptual work which will 
attack the various problems. 

Russell concludes that the considera- 
tion of the various theoretical frames 
indicates that, “There are a number of 
avenues along which investigation might 
proceed” (p. 269) and states, “It would 


* This article by A. W. Staats appears 
under the title of “Comments on Pro- 
fessor Russell’s Paper” in Verbal Behavior 
and Learning (C. N. Cofer and B. S. 
Musgrave, eds.), McGraw-Hill, 1963. Re- 
printed by permission of the author and 
McGraw-Hill. 

1 This work was supported by the Office 
of Naval Research under Contract Nonr- 
2794(02), by the Office of Education, Co- 
operative Research Program, under Con- 
tract 1048, and by the National Insti- 
tute of Mental Health under Contract 
2381(02). 


. . seem worthwhile to undertake re- 
search exploring the consequences of the 
laboratory manipulations usually associ- 
ated with research on purpose in a more 
theoretically neutral fashion, using the 
experimental tasks that seem most likely 
to reflect the influence of any possible 
selective processes” (p. 269). 

In the first part of my comments deal- 
ing with the complex topic of purpose, I 
would like to make a case for an S-R ap- 
proach, and later describe some of my 
research which I think is relevant to the 
problem of set. 

First, however, I would like to include 
myself among those whom Russell de- 
scribes as teleophobic in attempting to 
“proceed with the investigation of varia- 
bles untainted by purposive connotations” 
(p. 260), although I do not feel it is 
necessary, in a sense, to ignore the be- 
haviors involved, hoping the problems 
will “aimlessly drift away.” As Russell 
points out, “Perhaps no fact has provided 
more difficulty for systematic psychology 
than has the obvious one that behavior 
can frequently be described in terms of 
some conceived end toward which it is 
directed” (p. 260). It appears to me, 
however, that there are difficulties in addi- 
tion to the complexity of the events in- 
volved. The additional problems stem 
from the terms and approaches which 
have been applied to the area, which still 
continue to survive, and which I think 
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obtrude their unproductive implications. 
For example, the terms “goal-directed,” 
“goal-secking,” “behavior which occurs in 
order to achieve something,” and so on, 
suggest that there is some influence by 
the goal itself—some future causality. A 
step away from this approach, with its 
obvious conflict with the demand for a 
demonstrable type of relationship between 
antecedents and consequents, is the idea 
that there is a “purpose” or “conception” 


or “intention” which precedes the be- 
havior, This allows for an acceptable di- 
rection of causality but has mentalistic 


overtones, unless the antecedent variables 
are specified—and may be only one step 
away from a teleology if there is the impli- 
cation that the as-yet-to-be-realized goal 
influences the intention. While it is true 
that Russell does not use the purposive 
terms with teleological connotations, I 
think that an analysis of the drawbacks in 
the use of such terms is productive here 
because of their implications for many 
people and because they are indeed un- 
necessary. The introduction of purposive 
terms does seem to include the goal as an 
event to be considered. And in relatively 
uncharted territory, depending upon how 
the problem is defined, different ap- 
proaches and methods are indicated. 
When the conceived end, or purpose, is 
considered as a behavior, however, other 
implications follow which are not mental- 
istic or teleological. The indication then 
is that the task is (1) reliably to describe 
the behavior involved, and (2) to estab- 
lish the independent variables of which 
it is a function. In addition, (3) as a 
stimulus producing occurrence, a behavior 
can have a “causing” or “determining” 
status. That this is more than word magic 
will, I hope, be shown as we go on. 
Russell describes several levels, or com- 
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plexities, of behaviors with respect to a 
stimulus condition. Thus, there are simple 
reflexes and tropistic responses whose re- 
lation to the stimulus is clear. And he 
states, when describing an organism’s ap- 
proach response to the presence of a rein- 
forcing stimulus, “As long as there is a 
plausible explanation for the occurrence 
of such behavior in terms of differential 
overt associative responses to objectively 
present, external stimuli, it would seem 
to add only an adjective to say that it was 
purposeful” (p. 262). It might help to 
add only that these occurrences are best 
described by referring to the past occa- 
sions where the organism’s approach to 
the visual stimulus has been followed by 
reinforcement, e.g., the operations for pro- 
ducing a discriminative stimulus for an 
approach response. It might indeed de- 
tract here to use the term goal-directed 
since this suggests the improper method 
of examining the relationship of the goal, 
as a goal, to the behavior. 

On the other hand, when the organism 
behaves in a manner described as looking 
for something which is not present, Rus- 
sell feels that the term purposive is appro- 
priately used. It is then that 


The behavior shown is more likely to be 
attributed to the operation of some state or 
mechanism within the organism, rather than 
to be interpreted as a simple case of differ- 
ential responding to external stimuli. When 
such hypothesized states or mechanisms are 
attributed characteristics which force the 
organism to behave in such a way that the 
behavior is describable with reference to 
some anticipated end, then it would seem 
that the term purposeful could be signifi- 
cantly applied to the behavior so mediated 


(p. 262). 


Thus Russell considers the term pur- 
posive as an inferred process of some type 
which mediates behavior. Whether the 
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term can be productively or significantly 
applied in even this manner, however, is 
questionable. 

Russell describes an example of this 
mechanism in the case of Professor Olson 
who gets up in the morning, drives on the 
route to his regular office, meets a road 
block, changes direction, detours through 
unknown streets until he meets a familiar 
toute again, and arrives at the hospital 
where he has an appointment. This be- 
havior can be termed purposeful—be- 
havior in order to get to the hospital, 
behavior with an anticipated end, behavior 
which seeks the hospital, behavior under 
the control of a personal conception of 
the objective. 

Russell adds that this type of descrip- 
tion of Professor Olson’s behavior does 
not provide an explanation of his actions 
but only clarifies what type of behavior 
will be considered under the term pur- 
posive. However, it does seem that some 
of the purposive terms tend to lead one 
away from consideration of the possible 
S-R processes involved and from the 
independent variables responsible for 
these processes, The hypothetical case of 
Professor Olson would not be so recondite 
if described in more detail in S-R terms. 
Upon arising in the morning Professor 
Olson opens his appointment book and 
texts the page for that day with the re- 
sponse, I HAVE TO BE AT SUCH AND SUCH 
HOSPITAL AT NINE O'CLOCK. I WONDER 
HOW I GET THERE. This verbal sequence 
then provides the stimulus controlling the 
responses of finding and scanning a map 
of the city. Tracing the route between his 
house and the hospital, he responds ver- 
bally, saying, TAKE MY USUAL ROUTE UNTIL 
I COME TO SEVENTH AVENUE. THEN RIGHT 
TO . . . etc., etc. Once in his car he drives 
for a time and then looks at the street 
signs, saying, I TURN RIGHT AT SEVENTH 


avenue. When the appropriate sign ap- 
pears he texts it as SEVENTH AVENUE, and 
this verbal response then controls the 
motor response of turning the car to the 
right. The professor then drives until the 
roadblock appears. At this time he re- 
sponds, TLL GO SOUTH FOR A BLOCK AND 
THEN CONTINUE EAST SINCE THAT WILL 
PARALLEL THIS STREET AND EVENTUALLY 
GET ME TO HIGHLAND BOULEVARD WHICH 
TAKES ME TO THE HOSPITAL. He continues 
on, texts HIGHLAND BOULEVARD, turns to- 
ward the hospital, reaches the hospital, 
responds to the stimuli present by looking 
around, sees an open place at the curb, 
parks the car, goes into the hospital, looks 


around, texts the directory with pr. MOR- 
RIS, ROOM 329, and goes to this office in a 
still complicated sequence of verbal and 


motor behaviors. 

Some of the texting responses involved 
in this sequence could be replaced by the 
individual’s own verbal response se- 
quences—and if the sequence occurred 
frequently enough, the behavior chain 
would occur without the support of the 
verbal behavior. That is, the motor be- 
haviors involved, since they also produce 
certain visual stimuli (in some cases pro- 
prioceptive stimuli would be effective), 
would come to control the behaviors— 
thus, each motor behavior would result in 
arriving at a visual stimulus situation 
which would control the driving responses 
involved, and so on. 

Although this is a hypothetical ex- 
ample, it seems to me, following this de- 
scription, that the end or goal in this, or 
any situation of this type, would be ir- 
relevant—and that use of purposive terms 
even in description of the behavior is mis- 
leading. If someone had placed a bomb 
in the office in which Professor Olson was 
to have the appointment—he would still 
go there. The determinants of Professor 
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Olson’s behavior are the past training 
circumstances concerned with the motor 
and verbal behaviors involved, and the 
manner in which they “mediate” the final 
behavior of entering the office. 

The fact that the professor upon re- 
quest could state that he was going to the 
hospital for an appointment would not 
change the situation. This behavior also 
is under the control of past events, actu- 
ally the same ones as those which have 
already been mentioned. Certainly, this 
verbal vior cannot be called the 


“goal” of the professor although it may 


enter into his getting to the hospital. It 
is simply verbal behavior under the con- 
trol of the appointment book notation. 
However, this is a very complex case, 
and perhaps an experimental example 


would be helpful here. Judson, Cofer, and 
Gelfand (1956) used Maier’s two-string 
problem: as the task for the subjects. Prior 
to being introduced to the problem, how- 
ever, the subjects received pretraining on 
a separate learning task. This task in- 
volved learning lists of words in serial 
order, For one group of subjects the words 
ROPE, SWING, and PENDULUM were inserted 
in that order into one list. Thus, this 
group of subjects learned this sequence of 
word responses. Other groups of subjects 
did not learn these words in that manner. 


Instructions 
S 


aR 


Looking 


s 
at strings ay 
R S- R 
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It would be expected that the group of 
subjects for whom the response sequence 
ROPE-SWING-PENDULUM had been estab- 
lished, on encountering the Maier two- 
string problem, would tend to respond 
with rore (or stRINc) to the cord in- 
volved in the problem. The response ROPE 
would produce stimuli which would elicit 
the response SWING, and swinc would 
elicit peNpuLUM. It would also be ex- 
pected that the sequence ROPE-SWING-PEN- 
putum would mediate the motor re- 
sponses of constructing a pendulum, using 
the cord and swinging it. (A schematiza- 
tion of this is presented in Figure 1.) 
Thus, subjects who had this verbal se- 
quence of responses established in good 
strength should be more likely to solve 
the problem. In general, the results of the 
experiment substantiated this prediction. 


FIG, 1. Schematization of the Judson, 
Cofer, and Gelfand study of problem 
solving in which the stimulus of the 
instructions sets the occasion for the Ss 
response of looking at the strings. The 
visual stimulus of the strings tends to 
elicit the verbal response ROPE, which 
is the initial response in the previously 
established verbal chain ROPE-SWING-PEN~ 
puLuM for experimental group Ss. This 
sequence then mediates the problem 
solving behaviors. From Staats: Verbal 
Mechanisms in Purpose and Set. 


Rope 


s R S 
Swing Pendulum Ae 
R 


Looking at object; 
tying object to string 
and swinging it 
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Although this is an experiment in rea- 
soning or problem solving, the same ele- 
ments are present as in the case of Profes- 
sor Olson. The goal, or end, here is in 
reality the present instructions to tie the 
string together; these instructions perform 
a similar function as did Professor Olson’s 
appointment book; that is, they mediate 
observing responses to the strings, etc., 
and the verbal and motor response se- 
quences then unfold. This example indi- 
cates, I believe, that the purposive terms 
are misleading. The same events are stud- 
ied without recourse to these terms or 
interest in the function of a goal. 

The example of Professor Olson is 
much more complex in the training vari- 
ables which must have been involved, in 
the controlling stimuli which were effec- 
tive, and in the behavioral repertoires dis- 
played. For example, each link in the 
verbal response sequences involved would 
be expected to be a hierarchy instead of a 
straightforward elicitation of the next re- 
sponse and no other. Thus, rather than as 
a smooth chain of verbal and instrumental 
responses, the chain would more realisti- 
cally be described as showing the relative 
strengths of competing responses involved 
at each stimulus point. In addition, the 
picture of verbal behavior described is 
oversimplified, since it included only oper- 
ant word responses and no mediating re- 
sponses of the “meaning variety,” which 
are developed under the principles of clas- 
sical conditioning. If Professor Olson had 
had previous experience of an aversive 
nature at hospitals, for example, his tex- 
tual sequence of responses to the appoint- 
ment book would also elicit a negative 
meaning response, which would tend to 
elicit avoidance responses. As a conse- 
quence, it might be seen that the alacrity 
of Professor Olson’s behavior would be 
missing. 


The above is meant only to suggest that 
a description in terms of behavior prin- 
ciples can be made without resort to a 
purpose mechanism. As Russell points 
out, analyses of such “homely illustra- 
tions” do not constitute experimental hy- 
potheses, but they can serve as a starting 
point. In this respect, however, since the 
above description is based upon principles 
which have arisen in controlled study, the 
nature of the independent variables un- 
derlying the complex purposive behavior 
is thereby suggested. That is, if one wishes 
to know how the individual responds ver- 
bally in a certain manner to the visual 
verbal stimuli in an appointment book, 
Skinner (1957) describes this; and there 
is ample evidence as to how visual dis- 
criminative operants are established and, 
specifically, how texts are formed accord- 
ing to the principles of reinforcement 
(Staats, Staats, Schutz, and Wolf, 1961). 
Since these textual responses themselves 
produce stimuli, the manner in which 
they can come to control motor behaviors 
should follow the same principles as those 
involved in bringing any behavior under 
stimulus control. And from a practical 
standpoint, if one is interested in develop- 
ing purposive behavior, relevant training 
variables and verbal and motor repertoires 
are suggested. It is this which makes a 
description in terms of behavior principles 
more than an idle pastime or a retreat to 
mentalism. This is not to suggest that 
these complex cases have been experimen- 
tally approached—it indicates only poten- 
tial. 

Russell indicates that stimulus-response 
processes are possibly involved in purpose 
and suggests, in addition, that meaning 
functions are likely to be involved. He 
then presents the problem of “how the 
purpose mechanism, whatever its source 
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and character, exercises its regulatory in- 
fluence upon behavior” (p. 265). 

On a general level, following from the 
previous S-R description, it could be said 
simply that the regulatory function occurs 
in the same manner as that in which any 
stimulus control occurs. That is, if what 
is called the purpose mechanism consists 
of chains of verbal and motor responses 
(some of which get the organism into new 
environmental stimulus conditions), then 
the resulting stimuli have the usual func- 
tion in eliciting the final response. 

In discussing this regulatory function, 
dealt with under the descriptive term set, 
Russell does describe Osgood’s mediating 
response (1957) and Huls fractional 
anticipatory goal response (1930). Russell 
suggests that study of these types of habit 
mechanisms may be one way of approach- 
ing the topic, but points out that Os- 
good’s treatment has drawbacks. 


As plausible as Osgood’s treatment may 
be, it has a technical difficulty that results 
from the very number of hypothesized stim- 
ulus sources which are considered. It is that 
even if the associative hierarchies of each 
stimulus source operating alone were known, 
there is still the problem of predicting the 
resultant when they are all simultaneously 
operating. Until this can be done with some 
accuracy, it will be difficult to test his pre- 
dictions in complex cases (pp. 266-267). 


However, the difficulty here seems to 
lie more with the complexity of the events 
under question, rather than with the at- 
tempt to deal with these events with be- 
havior principles. Prediction of the com- 
plex case, even when the principles have 
been ascertained, is a practical problem 
and rests upon knowledge of the inde- 
pendent variables involved. The physicist 
cannot predict the flight of a feather be- 
cause he does not have the appropriate 
information though he knows the princi- 
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ples which are operative. On the other 
hand, on the basis of the principles, he 
can manipulate independent variables to 
produce many important results. 

The same types of possibilities are pres- 
ent in the areas of study under considera- 
tion. Although some complex set behav- 
iors could not be predicted in everyday 
life because many unknown variables are 
operating, it is not unreasonable to expect 
that when the principles are well under- 
stood, it will be possible to manipulate 
variables to produce the desired behavior 
in this area. 

Specific knowledge of the principles, of 
course, will stem from a piecemeal attack 
on the complex case, broken down and 
studied in the laboratory, as Russell points 
out. The question at this point is what 
basic principles and methods to apply in 
the laboratory study of set. Are behavior 
principles the most likely prospects for 
success in this task? I think so, and I 
would like to present several studies 
which we have conducted in a program 
of a piecemeal approach to one problem 
of set. 

Russell describes sets in verbal learn- 
ing and verbal behavior as “the manner 
in which the use of language is selectively 
directed, how certain verbal structures are 
‘tuned,’ or ‘primed,’ how certain ‘sche- 
mata,’ are adopted, or how particular 
‘supraordinate categories’ are activated” 
(p. 258). In Russell’s description, it seems 
to me there are two separable types of 
events: (1) the “verbal structures,” “cate- 
gories,” or “schemata”; and (2) the way 
in which these are “tuned,” “primed,” or 
“activated.” 

In our laboratory, we too have been in- 
terested in dealing with these two types 
of events, but we have approached these 
topics by working with the operant con- 
ditioning of word classes. A word class 


220 Communication 


may be considered a verbal structure or 
category, and operant conditioning, in 
this case, can be considered in terms of 
its activating or tuning effect. Although 
the principle of operant conditioning has 
been frequently tested in the area of verbal 
behavior (see Krasner, 1958; Salzinger, 
1959), the variables underlying the forma- 
tion and function of the word classes or 
verbal structures involved (i.e. the set 
mechanisms) have received scant atten- 
tion. 

For example, in Salzinger’s article sum- 
marizing studies of the operant condition- 
ing of word classes, it is suggested that 
responses making up a word class are 
those which may be substituted for one 
another, are followed by the same rein- 
forcement, or are emitted in the presence 
of the same discriminative stimulus. This 
does not appear (see Staats, 1961) to be 
an adequate rationale for the fact that the 
reinforcement of one word response 
strengthens other members of a class of 
words. Therefore, I would like to present 
what I consider to be a more detailed 
conceptual and experimental analysis 
which, at the same time, represents an 
analysis of a certain type of set. 

Cofer and Foley (1942), Mowrer 
(1954), Osgood (1953), and Staats and 
Staats (1959) have discussed word mean- 
ing in terms of Hullian concepts as an 
implicit, mediating response. According 
to this interpretation, when a word is con- 
tiguously presented with a stimulus ob- 
ject, some of the unconditioned responses 
elicited by the object will be conditioned 
to the word. These responses when stably 
conditioned become the meaning of the 
word. First-order conditioning of meaning 
has been demonstrated by Staats, Staats, 
and Crawford (1958). Additional support 
for the contention that the concept of 
meaning may be treated as a conditioned 


response is given by a series of studies 
(Staats and Staats, 1957; Staats Staats, 
and Heard, 1961) in which con ‘tioning 
was accomplished by pairing a word which 
already elicited a meaning response with 
the verbal stimulus to be condition 
elicit that meaning, i:e., a higher 
conditioning paradigm. Both connotative 
and denotative meaning responses were 
conditioned. 

In addition, suggestions concerning the 
nature of the conditioned meaning re- 
sponse have been offered elsewhere (Os- 
good, 1953; Staats, 1961), and it will suf- 
fice to point out here that the conditioned 
response may be considered an autonomic 
response, an implicit motor response, or 
the conditionable portion of a sensory re- 
sponse. Thus, when a word is paired with 
an unconditioned stimulus eliciting 
motor, autonomic, or sensory resp 
part of the response is conditioned 
word. 

On the other hand, word responses also 


come under the control of stimulus ob- 
jects, according to the principles of oper- 
ant conditioning (Skinner, 1957). That is, 


a word response reinforced in the presence 
of a stimulus (and not in its absence) will 
come to be elicited (or controlled) by 
that stimulus. In this process, the word 
response comes to be elicited by the 
motor, autonomic, or sensory response 
produced by the stimulus (including 
those parts of the response which are con- 
ditionable as meanings). Thus a word as 
a stimulus-producing response comes to 
elicit a conditioned meaning response, but 
in addition, this same response comes to 
elicit the word response. This is depicted 
in Figure 2. The word sarr is elicited 
by the sensory response elicited by the 
object ball. In addition, BALL as a response 
elicits the conditionable parts of that sen- 
sory response. 
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At this point, the class of words consists FIG. 2. The stimulus object ball elicits a 
of only one member. However, not only sensory (meaning) response which, in the 
will the word sarı be reinforced in the RS Oa: 
esence ofhesti 1 ee imil verbal response BALL. The word BALL has 
prs encer e stimulus objec (or similar been classically conditioned to elicit the 
objec ts), but other responses will also be same meaning response by being paired 
simila treated, €.g., ROUND, CIRCULAR, with the object ball. The object ball also 
SPHE \L, ORANGE, BALLOON, and so on. elicits sensory responses which are not 
aay Ne d f 5 conditionable and which control the word 

Stimuli produced by these responses will ai ; 

k 2 8 y response BALL, but this is not depicted. 
also paired with the objects in the From Staats: Verbal Mechanisms in 
classical conditioning of meaning. If in Purpose and Set. 
language learning, groups of words come 
to elicit the same meaning response com- 
ponent on the basis of being paired with 
the same or similar stimulus objects, and FIG. 3. A number of verbal responses 
if the same meaning response component, have been operantly conditioned in the 
through the stimuli it produces, comes to presence of the same or similar round 

1 cea j i icit th i a 
control the emission of each of the word obieni which elicit the round meaning z6 
i A sponse. Thus, the verbal responses tend to 
responses in the class, then a mechanism be elicited by that round meaning com- 
would exist which would constitute a ver- ponent. The same word stimuli have also 
bal structure or set on the basis of which been paired with similar round objects 
operant conditioni: f th 1 anid and have come to elicit the round meaning 
pera A besi itioning O: ne class cou response. Consequently, any object (or 
occur, This verbal structure may be called word) which elicits the round meaning 
a verbal habit family, using a Hullian-type response will tend to elicit the various 
terminology. The verbal habit family for verbal responses. This constitutes the 
u Setä redui 3 verbal habit family for “roundness.” From 
roundness” is schematized in Figure >. Staats: Verbal Mechanisms in Purpose 
In the various studies of the operant and Set. 
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conditioning of word classes, conditions 
are manipulated so that the subject emits 
words. When a word response which is a 
member of the class the experimenter has 
chosen occurs, the experimenter presents 
some reinforcing stimulus. It is found that 
the frequency of the emission of the other 
members of the word class increases. This 
occurrence can be accounted for on the 
basis of the verbal habit family in the fol- 
lowing manner. When the word response 
is reinforced, both the word response and 
the meaning response elicited by the word 
would be conditioned to the cues of the 
situation. However, since the meaning re- 
sponse component would also tend to 
elicit each of the word responses in the 
class, strengthening the tendency of the 
situation to elicit the meaning response 
would raise the probability that each of 
the word responses would be emitted. 
Each time one of the members of the 
class was emitted and reinforced, the 
strength of the habit family in that situa- 
tion would, in this manner, be increased. 
This would not be the case for any word 
emitted in the situation and not rein- 
forced, i.e., a nonclass word (Staats, 
1961). 

On the basis of this rationale, a study 
(Staats, Staats, and Finley, 196la) was 
recently completed in which a group of 40 
words was selected, each of which pos- 
sessed positive evaluative meaning, that is, 
each one of the words elicited a “positive 
evaluative” meaning response component, 
although the various words also elicited 
other meaning responses. Each of these 
words was presented on a card with three 
other words of unsystematic meaning. 
Randomization procedures were followed 
with respect to the position of the words 
on the cards, as well as the order of the 
cards. The subjects in the experimental 
group were presented with each card, were 


directed to select one of the four words, 
and were socially reinforced by the experi- 
menter upon selecting one of the positive 
meaning words. Control group subjects 
were not reinforced. Figure 4 presents 
the results, which indicate that a group 
of word responses, each of which elicited 
a common meaning response component, 
could be operantly conditioned as a class. 

Consideration of the verbal habit-family 
model, however, leads to the expectation 
that any group of words which elicited a 
common response, if that response also 
tended to elicit each of the word re- 
sponses, would condition as a class, i.e., be 
susceptible to set phenomena. An exam- 
ple of this may be found in the word- 
association norms of Russell and Jenkins 
(1954). The word steep elicits BED, 
DREAM, COMFORT, and DEEP as associates 
to varying degrees. BED, DREAM, COMFORT, 
and beep in turn also elicit steep. This 
response class is shown in Figure 5. 
Thus, it would be expected that reinfore- 
ing an individual every time he emitted 
one of the words that elicits strep would’ 
strengthen the response ster to the stim- 
ulus situation. The situational stimuli 
would thus tend to elicit steep and 
thereby increase the probability that the 
associates to sLEEP would occur in the 
situation. Because of the few words in- 
volved in this class, of course, it would 
be difficult to condition the class oper- 
antly. However, a large number of sub- 
jects in an experiment of this type might 
be used to demonstrate the effect. Or a 
word class of this type which included 
more members could be formed in the 
laboratory. 

Russell and Storms (1955) have shown 
that the implicit word associates of a stim- 
ulus word elicited upon presentation of 
the stimulus word may have a learning 
function. That is, subjects were able to 
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acquire an A-D association, where A-B, 
B-C, and C-D associations already existed. 
It could thus be concluded that pres- 
entation of A tended to elicit B impli- 
citly, B tended to elicit C, and C tended 
to elicit D. 

On the basis of implicit chains of verbal 
responses, it would be expected that any 
serial chain of word associates, i.e., word 
responses, would demonstrate set charac- 
teristics in the operant conditioning situ- 
ation. That is, if the first response in a 
chain were emitted, its word associates, 


3 
Blocks 


FIG. 4. The mean number of positive 
word responses for the five successive 
blocks of items for experimental and 
control group Ss. From Staats: Verbal 
Mechanisms in Purpose and Set. 


forcement would then strengthen the 
tendency for all of the implicit responses 
to be elicited by the situation. If the next 
response in the chain occurred, the same 
process would be repeated and would 
make it even more likely that the third 


FIG. 5. The “sleep” word response class. 
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response in the chain would be elicited. 
Each succeeding word response in the 
chain, when it occurred, would further 
increase the likelihood that the next re- 
sponse would be elicited. The Pledge of 
Allegiance would constitute such a word 
class for an individual raised in the United 
States, as would poems, rituals, and 
shorter word-association chains. 

It would also be expected that a serial 
chain of responses would constitute a 
word class in an operant conditioning 
situation even when not emitted in the 
serial order. That is, when a series of 
word responses are chained in a serial 
learning task, associations are formed be- 
tween words other than those which are 
directly contiguous (Postman and Egan, 
1949). 

However, the closer the order to that in 
the serial learning task, the stronger the 
associations would be and the greater the 
extent of operant conditioning expected. 

These expectations were tested in the 
following study (Staats, Staats, and Fin- 
ley, 1961b). The subjects separately 
learned two serial lists (two word response 
chains) by the paired-associate method 
of anticipation. The items on the lists 
were nonsense words, e.g., HUFOD, TEBAM, 
sozoc. Later, the first words from each 
of the lists was placed upon one card, the 
two second words on another, and so on. 
Then, in the serial order, the cards were 
individually presented to the subject with 
instructions to select one word. The word 
responses in one of the lists (the list op- 
posite to that which was chosen on the 
first card) were then reinforced. The rein- 
forcer was a pencil tap as a “point,” as 
used by Verplanck (1956). Of the three 
subjects so treated each selected 9 or 
more words from that list out of the pos- 
sible 11—a statistically significant per- 


formance in each individual case—for a 
mean of 9.67. This procedure was repli- 
cated for six additional subjects with one 
change. The order of the presentation of 
the words in the operant conditi ning 


phase of the experiment was 1-3-5-7-9-11- 
2-4-6-8-10-12. The mean number of words 
from the reinforced list was 7.50, Another 
group was run in which the order of pres- 


entation of the words was random. The 
mean for this group was 6.67. And finally, 
for a control group where the word re- 
sponse sequences were not established at 
all, the mean number of responses selected 


from the reinforced list was 5.67. The 
results for the four groups are shown in 
Figure 6. Thus, the extent of operant 
conditioning of the groups was greatest 


for subjects operantly conditioned in serial 


order, next greatest for subjects presented 
the alternate order, next for subjects re- 
ceiving the random order, and least for 
the control subjects. A regression analysis 
of the treatment condition indicated a 


linear trend significant at the .005 level. 
That is, the conditionability of the class 
of word responses was dependent upon 
the strength of associations between the 
words. In other terms, it could be said 
that the effect of set depended upon the 
strength of associations. The serial train- 
ing procedure produced a class of word 
responses for an operant conditioning 
situation. 

In addition to this type of word response 
class, any words which occur frequently 
in contiguity with each other should con- 
dition as a class. Take, for example, the 
word associates to a stimulus word in 
word-association norms. Many of them 
are interassociated, e.g., in the word re- 
sponses to Music there are swEET and 
sort, but sweer and sorr also elicit 
music. In addition the word Loup, al- 
though not elicited by music, is elicited 
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by sort. Thus, Loup would tend to occur 
as a response to Music, since it is medi- 
ated by the response sorr. Now Loup as a 
stimulus word has as its associates a num- 
ber of responses which are also direct 
associates to Music, as well as the word 
music itself. This complex network of in- 
terrelated associations is illustrated in 
Figure 7. If complete word-association 
norms were available for these words, ad- 
ditional inter-associations would be seen. 


FIG. 6. Mean number of correct word 
responses for each of the serial learning 
study treatment groups. From Staats: 
Verbal Mechanisms in Purpose and Set. 


FIG. 7. Some of the interassociations 
established between the word associates 
to Music. From Staats: Verbal Mecha- 
nisms in Purpose and Set. 
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Such a group of words should thus 
operantly condition as a class. This was 
tested (Staats, Staats, and Minke, 1961), 
using the methods of operant condition- 
ing already described, for the word asso- 
ciates to Music. That is, 25 associates to 
the word music were taken from Russell 
and Jenkins (1954), and each was pre- 
sented with two nonmusic words on a 
card to two groups of subjects. All sub- 
jects were instructed to select one of the 
three words. In the experimental group 
the selection of a music word was fol- 
lowed by the reinforcement of the pencil- 
tap point, but no responses were rein- 
forced in the control group. The results 
indicated that the number of music word 
responses significantly increased, and in a 
linear fashion (p < .01), for the experi- 
mental group relative to the control 
group. The results are shown in Figure 8. 

On the basis of this evidence, which is 
not yet complete, it is now possible to 
analyze this aspect of the problem of set 
in greater detail. Salzinger stated that 
word classes are formed when the same 
discriminative stimulus controls the vari- 
ous words. This statement is incomplete, 
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if not incorrect, on several grounds. First, 
the same S? does not control all the 
words in the classes which have been 
operantly conditioned; e.g., not all living- 
thing words are controlled by the same 
stimulus. Even if Salzinger’s statement 
was accepted there would still remain the 
question of why word responses con- 
trolled by one stimulus should behave as 
a class in a situation in which this S? was 
not present. When the S-R principles are 
considered in greater detail, however, the 
picture becomes clearer. Words may not 
be controlled by the same specific SP but 
by several SP’s which occur in conjunc- 
tion. For example, a symphony concert is 
a complex stimulus situation in which 
such words as LOUD, SOFT, SWEET, MUSIC, 
HORN, NOTES, MELODY, and so on, are 
likely to occur, controlled by the various 


FIG. 8. Mean number of Music associates 
emitted in each block of five trials for 
experimental and control group Ss. The 
experimental Ss were reinforced upon 
each emission of an associate to MUSIC, 
while none of the responses of the control 
Ss were reinforced. From Staats: Verbal 
Mechanisms in Purpose and Set. 
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specific stimuli. As a consequence, word 
associations will be formed between the 
word responses, and they will function as 
a class in the manner described. The same 
associations, however, could also be 
formed on the basis of reading an account 
of the symphony, so that tacting would 
not necessarily be involved in the forma- 
tion of the verbal structure. 

Another statement of Salzinger’s was 
that words reinforced by the same stimu- 
lus would function as a class. Again this 
is incorrect, or at least incomplete. First, 
many word responses are reinforced by the 
same social reinforcers but are not in the 
same response classes. On the other hand, 
food-word mands, such as MILK PLEASE, 
BREAD PLEASE, and so on, are reinforced by 

ifferent stimuli and yet they are in the 
‘Jass. In the terms developed herein, 
, the interpretation of the devel- 
opment of this class of words might be 
that salivation would come to elicit all 
food words and be elicited by all of them 
—thus, forming a verbal habit family. On 
this basis, a class of food words should 
be capable of operant conditioning. 

I have used a particular research series 
to demonstrate the application of S-R 
principles and methods to the problems 
of set. The problem is one in verbal learn- 
ing, involving both verbal structure (or 
set), as well as the activation of the struc- 
ture; it hews closely to the aspects of set 
which Russell describes. The problem se- 
lected also indicates that the use of the 
term set is largely arbitrary, since operant 
conditioning of word classes has been 
studied without recourse to the term. I 
hope the above examples also additionally 
serve to indicate that verbal behavior is 
one field and that the principles studied 
in the various subareas of operant condi- 
tioning, paired-associate and serial learn- 
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ing, word-association norms and media- 
tion, and semantic conditioning and 
mediation are all operative when complex 
cases are considered in detail. Especially, 
I am interested in indicating that the 
operant conditioning of word classes is 
not a new and separate area in verbal 
learning. It depends upon principles and 
results available in other fields. 

Although the complex behavior in 
everyday life may be difficult to predict 
since a number of S-R mechanisms are 
involved, the mechanisms may be capable 
of separation and thus be susceptible to 
investigation in the laboratory. Such in- 
vestigation, on the other hand, should 
eventually yield the customary products 
of prediction and control. 

I don’t wish to give the impression that 
the research summarized is the only or the 
first attempt to attack the various prob- 
lems of set with S-R principles. A number 
of other studies furnish the same type of 
evidence. For example, using anagrams 
and water-jar problems, Maltzman and 
associates (1953) have indicated that Hul- 
lian concepts of response hierarchies and 
drive are applicable in indicating some of 
the characteristics of the selective mecha- 
nisms, Maltzman and associates (1958), in 
addition to another study using the two- 
string problem (Staats, 1955), have shown 
that verbal responses to problem-solving 
objects are an index of later performance 
in the problem. Adamson (1959) has 
shown that schedule of reinforcement of 
anagram solutions affects the persistence 
of the solution (i.e, the rigidity of set). 
And the S-R verbal mechanisms involved 
in a number of verbal set behaviors have 
been studied by Bousfield and associates 
and Cofer and associates (see Bousfield, 
1953; Bousfield and Cohen, 1953; Bous- 
field, Whitmarsh, and Berkowitz, 1958; 
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Judson and Cofer, 1956; and Havron and 
Cofer, 1957). 

On the basis of these demonstrations, I 
would suggest a redefinition of the prob- 
lems of set and purpose which would deny 
a special mechanism, or category of behav- 
ior. While recognizing the need to deal 
with complex behaviors of the type de- 
scribed by Russell, it seems that S-R prin- 
ciples will suffice. In these terms, the 
problem is first an adequate description 
of the behaviors involved, second an anal- 
ysis of the S-R mechanisms, and third 
a laboratory isolation and simplification of 
the interacting mechanisms. Certainly, 
S-R principles are potentially, at least in 
combination, capable of the complexity 
seen in human behavior in everyday life, 
That is, stimulus events vary in type (i.e. 
exteroceptive, interoceptive, and proprio- 
ceptive) and are capable of variations in 
the strength with which they elicit or 
control responses. Chains or sequences of 
behavior are capable of extensions in 
terms of the number and types of units 
involved, and the individual units are 
capable of combination into hierarchies. 
Thus, there may be hierarchies of stimuli 
which elicit chains of responses which 
mediate hierarchies of other responses. In 
addition, verbal behaviors, as one type of 
response, allow for the long-term direc- 
tion of behavior which leads to labels of 
“purposive,” and so on. Although there 
are infinite variations in complex human 
behaviors, the S-R mechanisms which 
have already been established are capable 
of combination into infinitely varied ar- 
rangements. 

One further point. As Russell points 
out in mentioning teleophobia, purposive 
terms and the behavior involved have 
been excluded by many S-R investigators 
as legitimate areas of study. In fact, be- 
cause of the mentalistic misuse of such 


terms as meaning, images, thinking 
even some types of overt language | 
iors, such events were also rejecte 
appropriate subject matter for stud 
possibly rightly so, since events which can- 
not be approached objectively should per- 
haps be overlooked in favor of more si 
ple and basic events. Probably 


experimental approaches to behavior 
could handle only simple behaviors with 
simple organisms. However, time 
passes, behavioristic psychology, building 
upon the more basic principles, has al- 
ready objectively approached some of 
these formerly taboo areas, as well as the 
area under discussion—and with success, 
The progression of this approach has been 
in the best tradition of science, beginning 
with the more simple events investigated 
in well-controlled circumstances, and ad- 


vancing to consideration of the more 
complex cases as methodology develops. 
Because of this history, and the well- 
established principles which have been 
produced, when there is a choice concern- 
ing which methodology and principles 
seem most applicable to a new area of be- 
havior, it seems reasonable to apply first 
those of the S-R approach. 
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Problem Solving 


Ir 1s DIFFICULT to sample experimental procedures which are representative 
of a learning approach to human problem solving. There have been many 
diverse experimental situations in which problem solving has been studied 
—even within the learning framework. A solution to the problem of pre- 
senting a discussion which has generality may be gained by presenting 
several theoretical formulations which include summaries of experimental 
research, In these formulations again we find that several different learning 
approaches and experimental methods come into integration, that is, the 
Hullian, Skinnerian, and “word-associational” approaches. It is interesting 
to see in this instance how well the approaches may be related when the 
idiosyncratic language features are minimized and the empirical principles 
of learning are used as the model. 

Maltzman, in the first article, discusses human problem solving in terms 
of compound habit families. In doing so he suggests that the elementary 
laws of behavior should also apply to this complex human behavior. Thus, 
principles such as reinforcement, extinction, primary and mediated gen- 
eralization, and so on, should function in the individual’s problem solving 
activities. Although Maltzman couches his statements in the theoretical 
concepts of Hull, for example, habit strength (s@r), reactive inhibition 
(I), and so on, it will be seen in the articles to follow, as well as those 
which have already been presented, that the enduring concepts which 
survive in the application of learning principles to human learning seem 
to derive from the elementary empirical behavior principles. 

Kendler and Kendler present a learning view of human problem solving 
which also derives from the same sources but which confines itself to basic 
terms, This formulation is also based upon experiments in which the ele- 
ments are more clearly shown than in many complex problem solving 
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situations. These authors emphasize the role of mediating responses in their 
analysis and marshall evidence in the support of the contention that medi- 
ating responses are involved in the problem solving behaviors of articulate 
humans. This formulation includes emphasis upon the importance of lan- 
guage in problem solving. 

Maltzman in the next article also considers problem solving to involve 
situations which elicit a hierarchy of responses in the individual, with the 
solution-response having only very low strength. Originality may be con- 
sidered in the same terms, as behavior which is infrequent under existing 
conditions but which is appropriate to those conditions. Working within 
the context of unusual word associations, Maltzman in this paper considers 
the general behavior of being original as subject to the principles of learn 
ing. He summarizes a series of his experiments which substantiate the 
proposition that procedures which induce and reinforce original behavior 
will result in the generalization of originality to other situations. 

In the philosophy of the British Empiricists great emphasis was placed 
upon the association of “ideas.” The mentalistic term idea was not fruitful 
in an explanatory sense, but later with the advent of experimental psy- 
chology individuals began to study the results of procedures of “associa- 
tion.” The field of verbal learning, which included the development of the 
memory drum and experiments in paired associate and serial learning, has 
meticulously studied some of the learning variables involved. The excerpt 
from Mednick’s article (as well as aspects of the preceding article of Maltz- 
man) is in the tradition of this approach to human learning, utilizing the 
concepts of word association structures to discuss creativity in problem 
solving. He considers creativity of response to involve the complexity of 
word response hierarchies elicited by a stimulus situation, as well as the 
lack of extremely dominant responses in the hierarchy. 

Verplanck applies the terminology and methods of operant conditioning 
to certain aspects of problem solving and clearly illuminates some of the 
traditional problems in this area of study. He begins his experimental quest 
in dissatisfaction with terms like awareness, hypotheses, and so on, which 
are used as pseudo-explanations of problem solving. Verplanck treats the 
verbal statements which subjects habitually make in problem situations as 
operant behaviors. In doing so problem solving is characterized to include 
chains of verbal responses, some of which are under the control of the 
problem solving objects, and some of which may control further problem 
solving behaviors. Verplanck’s experiments are notable in making directly 
observable the types of mediating verbal responses which are only indirectly 
studied in most other experiments on problem-solving. 

Abstracting from these various formulations, it might be stated that 
verbal responses under the control of the problem solving objects are 
initially important. Furthermore, the subsequent verbal associations (intra- 
verbals), which the initial verbal responses control, constitute the second 
link important to problem solving. Finally, these verbal associates may 
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control terminal verbal or nonverbal problem solving behaviors. At any 
step of the chain, hierarchies of responses may be involved, rather than 
single responses. In the complex problem solving which occurs in everyday 
life these chains could be expected to be extremely intricate both in length 
of chain as well as complexity of hierarchical structure. 


23. 
Thinking: From a Behavioristic Point of View*' 


Irving Maltzman 


Hull (10) has demonstrated that the 
habit family hierarchy and related prin- 
ciples may generate many hypotheses 
concerning behavior in relation to ob- 
jects in space such as might occur in 
the Umweg problem or simple kinds of 
novel behavior. He has thus shown that 
the elementary laws of behavior may be 
applicable to behavior of non-speaking 
organisms in so-called reasoning situa- 
tions. 

The purpose of this paper is to dem- 
onstrate that the principles formulated 
by Hull and by Spence may also be ap- 
plicable to the problem solving of articu- 


*From I, Maltzman, Thinking: from a 
behavioristic point of view, Psychol. Rev., 
62, 275-286 (1955). Reprinted by per- 
mission of the author and the American 
Psychological Association. 

1 Portions of this paper were presented 
in a symposium on “Future Trends in 
Problem Solving” held at the 1954 meet- 
ings of the Western Psychological Asso- 
ciation. 


late humans. In this respect the present 
analysis has much in common with the 
important formulations concerning me- 
diated generalization and problem solv- 
ing by Cofer and his associates (2, 3), 
Dollard and Miller (5), Doob (6), and 
Osgood (19). The behavior theory in- 
volved may be outlined as follows. Be- 
havior is a function of effective reaction 
potential (sz), which in turn is a mul- 
tiplicative function of habit strength 
(sHp) and the effective drive state (D) 
minus the total inhibitory potential (Iz). 
The latter represents the summation of 
reactive (I,) and conditioned (sIr) in- 
hibition. It is assumed here that the effec- 
tive drive state represents the summation 
of the anticipatory goal response (rg-sg) 
as well as the primary and secondary 
drives (23). Furthermore, the multiplica- 
tive effect of the anticipatory goal re- 
sponse is restricted to its associated class 
of instrumental responses. 

The principal theoretical conception 
necessary for our account of problem 
solving is an extension of Hull’s spatial 
habit family hierarchy (9, 10). The great 
complexity of human thinking requires 
the formulation of what might be called 
compound temporal habit family hier- 
archies. In the spatial habit family hier- 
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archy, alternative locomotor responses are 
elicited as a function, in part, of spatial 
and temporal distance from a goal. But 
in adult human problem solving, re- 
sponses in changing spatial relations to a 
goal are not usually elicited, although 
there are problems involving motor skills 
in which this may be the case. A typical 
performance change in problem solving is 
in terms of verbal responses, and the 
change is solely a temporal one (4). 
Nevertheless, it is assumed that the prin- 
ciples operating in the spatial habit fam- 
ily hierarchy will to a large extent oper- 
ate in the temporal hierarchy. Recent evi- 
dence in support of this assumption has 
been obtained by Rigby (21). 

The conception of a compound tem- 
poral habit family hierarchy is based 
upon the prior assumption that the ele- 
mentary laws of behavior derived from 
conditioning and applicable to trial-and- 
error and discrimination learning are also 
applicable, at least in part, to primary 
problem solving or reasoning, and think- 
ing in general. That different kinds of be- 
havior are observed in conditioning, trial- 
and-error, discrimination, and problem- 
solving situations is not to be denied. But 
these different behaviors need not neces- 
sarily involve fundamentally different 
laws. Different behavior is observed in 
these situations because the initial condi- 
tions are different, and the situations rep- 
resent varying degrees of complexity in 
the sense of the number of different vari- 
ables and principles operating in them. 
Nevertheless, it is reasonable to assume 
that at least some of the elementary laws 
derived from conditioning will lead to 
the development of the composition laws 
operating in human problem solving. 

As Hull (10) has demonstrated, these 
elementary laws can account for many 
of the phenomena of simple trial-and- 


error learning. A hierarchy of responses 
elicitable by a given stimulus, in which 
the correct response is relatively low in 
the hierarchy, characterizes this form of 
behavior, as shown in Fig. 1. Learning is 
said to be complete when the order of 
the response hierarchy has so changed 
that the correct response is now dom- 
inant in the hierarchy. Hull has called 
this hierarchy of responses, elicitable by a 
given class of stimuli, the divergent 
mechanism (9). 
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FIG. 1. A divergent mechanism. The 
stimulus has varying tendencies to elicit 
the alternative responses: From Maltz- 
man: Thinking: From a behavioristic 
point of view. 


As Spence (22) and Hull (10) have 
demonstrated, the elementary laws of be- 
havior derivable from conditioning situa- 
tions can also account for many of the 
phenomena of simple discrimination 
learning. A hierarchy of stimuli eliciting 
a given response in which the correct cue 
is relatively low in the hierarchy charac- 
terizes this form of behavior, as shown in 
Fig. 2. Such learning is said to be com- 
plete when the order of the stimulus 
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FIG. 2. A convergent mechanism. The al- 
ternative stimuli have varying tendencies 
to elicit a given response. From Maltz- 
man: Thinking: From a behavioristic 
point of view. 


hierarchy has so changed that the correct 
cue is dominant. Hull has called this 
hierarchy of stimuli eliciting a given re- 
sponse the convergent mechanism (9). 

A synthesis of the divergent and con- 
vergent mechanisms gives rise to the 
habit family hierarchy involved in be- 
havior sequences in relation to objects in 
space (9, 10). A hierarchy of this sort is 
shown in Fig. 3.2 


2 There have been a few minor devia- 
tions from Hull in the manner of diagram- 
ming the stimulus-response relationships in 
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As seen in this figure, Sa (the external 
stimulus) and Sp (an internal drive stim- 
ulus) are capable of eliciting a given habit 
family hierarchy and equivalent responses 
leading to a given goal. Common to all 
responses in the hierarchy is a fractional 
anticipatory goal response (rga-sga) which 
is associated with both the external and 
internal sources of stimulation. Responses 
in the hierarchy may be elicited directly 
by either the external or internal stimuli, 
or by both. The effects of reinforcement 
or extinction of individual members of 
the hierarchy generalize to other mem- 
bers through the mediating mechanism: 
of the anticipatory goal response and its 
stimulus. It therefore follows that the 


order to simplify their presentation. Instead 
of having a dashed line between the stimu- 
lus and each response member of the diver- 
gent mechanism, a single dashed line lead- 
ing to a bracket is used. All bracketed 
responses are associated with the stimulus. 
The number and length of the response 
sequences have also been reduced, A dashed 
line between a stimulus and a response 
signifies a learned association, while a solid 
line between a response and the cue it pro- 
duces indicates an unlearned association. 


FIG. 3. A habit family hierarchy produced 
by a divergent and a convergent mecha- 
nism. From Maltzman: Thinking: From 
a behavioristic point of view. 
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principles of conditioning and trial-and- 
error learning should also apply, at least 
in a general way, to the habit family 
hierarchy. 

For example, if the reaction potential 
of the correct response leading to a goal 
is low in the hierarchy, then the general- 
ized conditioned inhibition from the re- 
peated failures of the dominant incorrect 
responses may reduce its effective reaction 
potential below the response threshold. 
Attainment of the goal would never oc- 
cur under the conditions present. Or, if 
the subject has a high degree of an ir- 
relevant need such as anxiety, aside from 
the possible interfering effects coming 
from the competing responses aroused by 
this drive, failure to attain the goal under 
the above conditions would be even more 
pronounced. The increased effective drive 
state multiplying the habit strengths for 
the dominant incorrect responses and the 
weak correct responses would increase the 
absolute difference in reaction potential 
between the two. Such a condition 
would produce a greater amount of con- 
ditioned inhibition generated through the 
repeated extinction of incorrect responses. 
This in turn would increase the proba- 
bility of failure. 


3 For illustrative purposes we may substi- 
tute numerical values in the formula for re- 
action potential (¿Eg =, H xD). The 
sHp value for the dominant incorrect re- 
sponse is 5; the gHp value for the weaker 
correct response is 2; drive has a value of 1. 
The absolute difference in reaction poten- 
tial between the correct and incorrect re- 
sponses is therefore 3. If the drive state is 
increased to a value of 2, then the absolute 
difference between responses becomes 6. A 
greater difference in reaction potential 
must now be overcome before the correct 
response can become dominant in the re- 
sponse hierarchy. 


Another way in which changes in the 
habit family may occur is through the 
arousal of the fractional anticipatory goal 
response (1ga-Sga). Its arousal may pro- 
duce an immediate increase in effective 
reaction potential for the related re 
sponses. This effect occurs because it pre- 
sumably enters into a multiplicative rela- 
tionship with habit strength in the de- 
termination of reaction potential. 

A synthesis of habit family hierarchies 
gives rise to the compound habit family 
hierarchy involved in human problem 
solving. A hierarchy of this sort is shown 
in Fig. 4. It is formed when the stimulus 
of a divergent mechanism becomes a 
member of a convergent mechanism as 
well. By the same learning process, re- 
sponses of the divergent mechanism in 
question become responses in convergent 
mechanisms. In the compound habit 
family hierarchy not only does S, have 
the disposition for arousing its habit fam- 
ily hierarchy, but to varying degree the 
habit family hierarchies of Sẹ and So as 
well. There is a hierarchy of habit fami- 
lies elicitable by S4. An analogous condi- 
tion holds for the other stimulus com- 
plexes, Sg and Sc. They have varying 
amounts of reaction potential for the 
elicitation of the other habit family hier- 
archies. These relations as well as the 
drive stimuli have been omitted in Fig. 4, 
in order to avoid confusing details. 

When the compound hierarchy is 
formed, Ry, for example, originally only a 
member of the divergent mechanism 
elicitable by S4, becomes a member of a 
convergent mechanism. There is now a 
hierarchy of stimuli, S4, Sz, So with dif- 
fering amounts of effective reaction po- 
tential for its elicitation. A similar state 
of affairs exists for the other response 
members of a hierarchy, as well as for the 
anticipatory goal responses. The stimulus 
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complex Są has varying amounts of re- 
action potential for the elicitation of the 
anticipatory goal response TgrSg» and 
Tg,-8g. as well as its original anticipatory 
response. We now have a hierarchy of 
habit family hierarchies or a class of 
classes of stimulus-response relationships.* 


4This presentation of the compound 
habit family hierarchy is an oversimplifi- 
cation, For one thing, it does not indicate 
that individual response members of a 
habit family may potentially serve as the 
anticipatory goal response for other habit 


FIG. 4. A compound habit family hier- 
archy produced by a combination of habit 
family hierarchies. From Maltzman, 
Thinking: From a behavioristic point of 
view. 


families. Also, the stimulus aspects of the 
compound hierarchy, and how they are re- 
lated to concept formation and perception, 
are not developed here. 

Theories of problem solving by Duncker 
(7), Duncker and Krechevsky (8) and by 
Wolters (25), although stemming from 
different points of view, have a number of 
characteristics in common with the com- 
pound habit family hierarchy. 
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Thinking in general, and problem solving 
in particular, thus may involve the selec- 
tion of habit family hierarchies as well as 
the selection of specific response se- 
quences within a hierarchy. 

If the selection of response classes or 
habit family hierarchies obeys the same 
principles as the selection of individual 
responses, then the task of discovering 
the principles of problem solving may be 
greatly facilitated. The laws derived from 
conditioning could then be used to ac- 
count for changes in the compound 
hierarchy, without, of course, necessarily 
excluding other principles. Maltzman and 
his associates have obtained some experi- 
mental evidence in support of this as- 
sumption (16, 17, 18). 

An additional basis for such an assump- 
tion is that the difference between instru- 
mental conditioning and problem solving 
in this respect may not be as great as it 
seems. In problem solving the members 
of a response class are qualitatively dif- 
ferent—for example, different verbal re- 
sponses. Effects upon one member may 
influence other members through medi- 
ated generalization, as previously indi- 
cated. In instrumental conditioning, 
changes in a response class, however, are 
also involved, because precisely the same 
response may not occur on successive 
trials (10). There are differences in in- 
tensity and, perhaps, in quality in the suc- 
cessive bar-pressing responses in the Skin- 
ner box. Nevertheless the rate of bar 
pressing increases with successive rein- 
forcements. Learning occurs even though 
a given response is not precisely repeated, 
because a class of similar responses is re- 
inforced as a result of simple stimulus 
and simple response generalization. The 
limits and the precise manner in which 
generalization occurs in the two situations 
are probably different. But because of its 


important theoretical implications for a 
theory of problem solving, the similarity 
between the two situations in this respect 
should not be discounted. 

Changes in the order of dominance in 
the compound hierarchy may occur as a 
result of either or both of two effects, 
First, the effective reaction potential of 
the incorrect dominant habit families and 
their individual members may be de- 
creased as the result of extinction. The 
initial response elicited in a given prob- 
lem situation would tend to be the dom- 
inant response in a dominant habit hier- 
archy. If this response does not lead to a 
solution, as by definition it would not, it 
would receive an increment in inhibitory 
potential, and responses next in the or- 
der of dominance would tend to occur. 
There would be temporary extinction and 
spontaneous recovery of these incorrect 
responses. Eventually the inhibitory po- 
tential of these responses would reduce 
their effective reaction potential below 
that of the responses contained in the 
hierarchy next in the order of dominance, 
and so on. Each response in the hierarchy 
need not be elicited and extinguished, 
however, since mediated conditioned in- 
hibition may generalize from one mem- 
ber of a hierarchy to another. The antici- 
patory goal response of this hierarchy 
presumably would also acquire inhibitory 
potential, thereby further reducing the 
effective reaction potential of the related 
class of responses. 

A second general way in which changes 
in the order of dominance in a com- 
pound hierarchy may occur is by increas- 
ing the effective reaction potential of the 
habit family or families initially low in 
the hierarchy which contain the correct 
responses. One way in which this may 
come about is as a result of previous re- 
inforcement of individual members of 
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the hierarchy in that situation. Through 
mediated generalization all members of 
the hierarchy would receive an increment 
in reaction potential. 

Another way in which a habit family 
may be raised in the compound hier- 
archy is through the arousal of the an- 
ticipatory response of the habit family. 
Elicitation of the anticipatory goal re- 
sponse produces an immediate increase 
in effective reaction potential for the re- 
lated class of responses, for the reason 
previously mentioned (15). The ante- 
cedent condition for the anticipatory goal 
response is assumed to be commerce with 
a goal or a substitute, often symbolic, for 
the goal. In adult human problem solv- 
ing the latter is the typical condition. Re- 
cent research indicates that verbal in- 
structions given by the experimenter pro- 
vide an important condition determining 
the arousal of the anticipatory response 
(2, 15). The consequent condition of its 
arousal is an increased probability of oc- 
currence of responses instrumental in at- 
taining the goal in question. 

These different ways in which changes 
in the compound habit family hierarchy 
may occur are related to the different 
kinds of problem solving distinguished 
by certain writers. As Hull (10) has 
pointed out, any learning situation other 
than classical conditioning involves prob- 
lem solving of some sort. The essential 
characteristics of a problem-solving situa- 
tion are that an organism is motivated, 
and that attainment of some goal object 
satisfying that drive is dependent upon 
the organism’s performing in a given man- 
ner. It is characteristic of problem solving 
that the appropriate response leading to 
goal attainment does not immediately oc- 
cur. This is true to some extent in instru- 
mental conditioning, and to a greater 
extent in trial-and-error learning and in 


what has traditionally been called prob- 
lem solving. 

Further distinctions between different 
kinds of problem solving have also been 
made. Maier (13, 14) has repeatedly dis- 
tinguished between different functions 
responsible for problem solving, and has 
classified problem solving as either pro- 
ductive or reproductive. The latter kind 
of thinking according to Maier involves 
the application of previously acquired ex- 
periences which lead to a correct solution 
in a new situation. It is problem solving 
based on the transfer of training, or 
equivalent stimuli, Productive thinking 
on the other hand is the consequence of 
the integration of previously unrelated ex- 
periences. The integration is produced 
by a direction which is an “outside” force 
not itself a habit. 

The present treatment of problem 
solving, as previously indicated, makes 
use of the concept of the fractional an- 
ticipatory goal response. Certain func- 
tional characteristics of the anticipatory 
goal response appear to make it an ana- 
logue of Maier’s concept of a new direc- 
tion. However, among other things, we 
do not accept Maier’s restriction that 
only productive thinking involves the 
combination of previously isolated habit 
segments, to use Hull's terminology. To 
some extent this is the distinguishing 
characteristic of all thinking, It is the fea- 
ture that sets it off from simple retention, 
and trial-and-error learning. All forms of 
thinking involve mediated generalization, 
and hence compounding of previously iso- 
lated habit segments. 

Nevertheless, there are differences be- 
tween reproductive and productive think- 
ing. Situations eliciting reproductive 
thinking often involve the presentation of 
a succession of problems. The solution of 
each of these requires the elicitation of 
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different response members of the same 
habit family hierarchy. This habit fam- 
ily will then become dominant in the 
compound hierarchy, as the result of 
reinforcement of its response members 
and the extinction of responses belonging 
to different habit families. As previously 
indicated, the increase in reaction po- 
tential of the entire class of responses as 
the result of reinforcement of individual 
members would occur as a consequence 
of mediated generalization. For example, 
subjects given a series of anagrams whose 
solutions all belong to the same word 
category will have a greater frequency of 
success on subsequent anagrams of the 
same category than subjects without such 
prior experience (20). However, failure 
on individual problems may occur be- 
cause a solution is still dependent upon 
selection of particular responses within 
this one habit family. 

The occurrence of reproductive think- 
ing in situations where only a single prob- 
lem is presented is also the consequence 
of the factors outlined. As a result of past 
training the dominant habit family in the 
compound hierarchy contains the correct 
response. Solution of the given problem 
depends upon extinction of the initially 
dominant incorrect responses within this 
one hierarchy. 

In productive thinking, on the other 
hand, a habit family initially low in the 
compound hierarchy must become domi- 
nant before a correct solution can be at- 
tained. This occurs as the result of the 
extinction of the dominant incorrect re- 
sponse hierarchies. Once the appropriate 
habit family is dominant a solution will 
occur, provided that the correct responses 
within that hierarchy in turn become 
dominant. The protocols of subjects in 
Duncker’s radiation problem exemplify 
this mode of thinking (7). 

If a subject incorrectly anticipates the 


goal or solution to the problem—e.g., 
“destroy the tumor by means of rays sent 
over a path as free as possible from 
healthy tissue”—the proposed solutions 
are alternative responses within the same 
dominant habit family, and are all at- 
tempts to achieve this end. Repeated fail- 
ure of these proposals will produce ex- 
tinction of the anticipatory goal response 
and its related instrumental responses. As 
a consequence, another habit family may 
become dominant. The subject will now 
anticipate a different kind of solution, 
such as “reduce the intensity of radia- 
tion.” As a result, all potential response 
sequences in the subject’s habit family 
leading to this goal are facilitated. If the 
correct solution (converging rays from 
different angles) is not the dominant 
response in this hierarchy, extinction of 
incorrect responses must occur before 
the solution will be attained. 

In an actual protocol this orderly pro- 
gression from one habit family to another 
is probably an infrequent occurrence. The 
more typical case would be one in which 
the reaction potentials of two or more 
habit families overlap. This would prob- 
ably be the case after the first few re- 
sponses from the dominant hierarchy 
have been extinguished. Thus reproduc- 
tive and productive thinking differ with 
respect to the kinds of changes which 
must occur in the compound hierarchy 
before a correct solution can be attained. 
In reproductive thinking the habit fam- 
ilies containing the correct responses are 
dominant at the outset of the problem, as 
the result of training and generalization 
from other situations. Or they rapidly be- 
come dominant in the compound hier- 
archy through the reinforcement of in- 
dividual response members of the habit 
family. In productive thinking the habit 
families containing the correct responses 
are initially low in the compound hier- 
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archy. They become dominant following 
the extinction of the dominant habit 
families which lead to incorrect solutions. 

Experiments on the effects of direction 
in the pendulum problem by Maier (12) 
and by Weaver and Madden (24) are a 
special case of productive thinking, in 
that instructions and demonstrations are 
employed to increase the reaction poten- 
tial of the anticipatory goal response and 
individual response members of the habit 
families leading to a correct solution. The 
problem is to construct two pendulums 
which would make chalk marks on two 
different places on the floor. In Maier’s 
experiment (12) one group of subjects 
was given only the statement of the prob- 
lem. Other groups received the statement 
of the problem plus various additional 
instructions or demonstrations. One of 
these groups was given three different 
demonstrations of operations on the ma- 
terial which were necessary for solution 
of the problem. They were shown how 
to make a plumb line, how to combine 
poles by using a clamp, and how to wedge 
poles against a surface. A third group 
was given these demonstrations and told 
that they must combine them for a solu- 
tion of the problem. A fourth group was 
told that it would be advantageous if 
the pendulum could hang from the ceil- 
ing. They were given a “direction.” The 
fifth group received the demonstrations 
and the direction. All of the problem solu- 
tions except one occurred in this last 
group. 

According to the present formulation 
the experimenter’s statement that it 
would be advantageous to hang the pen- 
dulum from the ceiling tended to elicit 
an anticipatory response for this goal. A 
wide variety of equivalent responses in- 
strumental in leading to this goal there- 
fore received an immediate increment in 
reaction potential. However, for a correct 
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solution to occur, certain specific re- 
sponses must be elicited. The three dem- 
onstrations given the last group increased 
the tendency of these responses to occur 
within their respective habit family hier- 
archies. The increased frequency of solu- 
tions under these conditions would follow 
from the differential increase in reaction 
potential of the relevant responses and 
the lawful nature of trial and error learn- 
ing. However, since a large number of 
responses belong to a given hierarchy, 
and the correct responses may still not 
be dominant, extensive extinction of in- 
correct responses must occur. If the cor- 
rect responses are very low in the domi- 
nant hierarchy, a solution may not occur 
at all because of the extensive generaliza- 
tion of the effects of extinction of the 
incorrect responses. Another basis for fail- 
ure in this group is that despite the in- 
structions tending to arouse the appro- 
priate anticipatory goal response, some 
subjects, presumably as the result of self- 
instructions, induce different anticipatory 
goal responses. These are the subjects 
that adopt an inappropriate approach to 
the problem, according to Maier. 

Groups 2 and 3, which are not given 
the directional instructions but receive 
the demonstrations, also have an increase 
in reaction potential for the three re- 
sponse sequences necessary for a solution. 
However, the anticipatory goal response 
and the related class of responses neces- 
sary to suspend the pendulum from the 
ceiling are not increased in strength, 
which is presumably why these subjects 
failed to solve the problem. However, 
contrary to Maier, Weaver and Madden 
(24) found no difference between the 
performance of groups 3 and 5. 

Their experiment implies that the ap- 
propriate habit family for suspending the 
pendulums from the ceiling may be 
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elicited by self-instructions, or that the 
increase in habit strength of the three 
necessary response sequences by itself may 
be sufficient for the solution of the prob- 
lem in some individuals. . . . 
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24. 
Vertical and Horizontal Processes in Problem Solving *’ 


Howard H. Kendler and 
Tracy S. Kendler 


Methodological Problems in Problem 
Solving Research 


. . . Anybody who does research is—or 
should be—aware that every decision he 
makes cannot be justified by facts or logic. 
Some decisions must be made on the 
basis of personal intuition. This is particu- 
larly true for the researcher in problem 
solving who must make three strategic 
decisions which cannot help but have 
profound influences on his research and 
the ideas they generate (Kendler, 1961). 
These decisions, which are not com- 


* From H. H. Kendler and T. S. Kendler, 
Vertical and horizontal processes in prob- 
lem solving, Psychol. Rev., 69, 1-16 
(1962). Reprinted by permission of the 
authors and the American Psychological 
Association. 

1 An earlier version of this paper was de- 
livered by Howard H. Kendler as an in- 
vited address to the 1960 meeting of the 
Eastern Psychological Association, which 
was held in New York City. The authors 
are indebted to the Office of Naval Re- 
search and the National Science Founda- 
tion for their support of the research 
reported in this paper. 


pletely independent, are related to the 
place of problem solving in psychology, 
the use of complex or simple experimental 
tasks, and the selection of a pretheoreti- 
cal model to guide research. Considering 
the volitional nature of these problems, 
as well as the current status of psychologi- 
cal knowledge, it would be both inappro- 
priate and erroneous to consider these 
methodological problems as offering only 
one sensible alternative. Adopting this 
point of view would do much to mini- 
mize the needless disputation that seems 
to perennially surround matters of re- 
search strategy. 

Accepting the principle that a basic 
research strategy is not simply an out- 
growth of logical and factual considera- 
tions does not reduce one to making de- 
cisions in either a haphazard or random 
manner. A given strategy can be adopted 
on the basis of rational considerations as 
long as it is realized that other reasonable 
attitudes might lead to the adoption of 
different decisions. 

The history of problem solving in par- 
ticular and psychology in general suggests 
that problem solving can best be concept- 
ualized not as a basic psychological proc- 
ess, but instead as one that reflects the 
interaction of more fundamental proc- 
esses (e.g, learning, perception, and 
motivation). 

If problem solving is not viewed as a 
unitary process, how is an appropriate ex- 
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perimental situation selected to investi- 
gate it? One possibility is that a prob- 
lem can be selected from a “true life” 
situation such as trouble-shooting elec- 
tronic equipment. Or problems can be in- 
vented (Duncker, 1945; Maier, 1930) 
that capture the flavor, if only partially, 
of problems we meet in everyday life. 

A more analytical approach can be 
taken to the selection of an experimental 
situation to investigate problem solving. 
If problem solving is compounded of 
elementary behavioral processes, then it 
may be more strategic to devise some 
simple problems in which the relation- 
ships of fundamental psychological mech- 
anisms to problem solving are high- 
lighted. That is, tasks should be devised 
not to duplicate or imitate everyday prob- 
lems, but instead to isolate and magnify 
the basic mechanisms that operate in 
such complex tasks. 

This analytical approach which is 
favored by the authors suffers from one 
major drawback. How is it possible to 
know the basic mechanisms of problem 
solving prior to their discovery? Obvi- 
ously, excepting divination, there is no 
method. But this does not prevent the 
analytical approach from operating. The 
researcher can prejudge theoretical issues 
by formulating a model of what he 
guesses problem solving to be like. The 
model can guide the investigator in select- 
ing the hypotheses to test, as well as the 
experimental situations in which to test 
them. 

This brings us to the third and most 
important decision a problem solving re- 
searcher has to make: his choice of a 
pretheoretical model (Koch, 1959). A 
pretheoretical model is not equivalent to 
a theory. The criterion of validity cannot 
properly be applied to it because essen- 
tially a pretheoretical model is an in- 


formal conception that operates as an 
analogy (Lachman, 1960). It is conceiy- 
able that different models (e.g., learning, 
perception, information theory) can all 
lead to fruitful and valid theories of prob- 
lem solving. 

Psychologists have many possibilities 
from which to choose their model. These 
models can be conveniently divided into 
two main categories: the empirical model 
that springs primarily from experimental 
data, and the formal model that is usu- 
ally generated by mathematical or logical 
systems. Among the empirical models 
that have achieved some acceptance are 
those that are based on introspective find- 
ings (e.g., the four successive stage model 
of “preparation,” “incubation,” “inspi- 
ration,” and finally “verification”), the 
facts of perception, and those of learning. 
Some formal models used are those de- 
pendent upon stochastic models, game 
theory, and the operation of computers, 

The present authors adopted an SR 
learning pretheoretical model. The deci- 
sion no doubt was influenced by profes- 
sional training and past research efforts. 
But other considerations entered, For the 
past 4 decades S-R learning psychologists 
have probably been the most active ex- 
perimental and theoretical group in psy- 
chology. To some, if not a large, extent 
this can be attributed to the fruitful and 
cleansing effect S-R language has upon 
designing, reporting, and interpreting re- 
search. S-R language forces the psychol- 
ogist to focus his attention on objectively 
defined environmental and behavior vari- 
ables and thus encourages the collection 
of data and the testing of ideas. The ef- 
forts of S-R learning psychologists have 
supplied a host of facts, concepts, and 
hypotheses that can be exploited in an 
exploratory excursion into the realm of 
problem solving. 


The facts and theories of learning, 
however, do not spontaneously coalesce 
to form a model that can guide research 
in problem solving. Some selection must 
be made. S-R learning theory does not 
represent a single organized formulation. 
Anyone who is familiar with the sys- 
tematic orientations of Hull (1952), 
Guthrie (1952), Spence (1956), and 
Skinner (1953) is aware of this. Many of 
these systematic differences, however, be- 
come attenuated and some even disap- 
pear when viewed from the distance of 
problem solving behavior. It is possible 
and perhaps even profitable to develop a 
learning model for problem solving that 
ignores many of the points of disagree- 
ment among S-R theories. 

Much of the objection to S-R language 
stems from the apparent discrepancy be- 
tween active, flowing behavior and the 
inert, static, single S-R association. Using 
S-R language does not mean that com- 
plex behavior actually consists of S-R con- 
nections. After analyzing the concept of 
light, Toulmin (1953), concludes: “We 
do not find light atomized into individ- 
ual rays: we represent it as consisting of 
such rays” (p. 29). Applying the same 
idea to the concept of the S-R associa- 
tion: “We do not find behavior atomized 
into individual S-R associations: we rep- 
resent it as consisting of such S-R asso- 
ciations.” The concept of the S-R associa- 
tion, therefore, must be judged not in 
terms of its ability to provide a clear image 
of behavior, but rather in its capacity to 
represent the facts of behavior. 


Pretheoretical Model of Problem Solving 


An S-R model needs to represent two 
important characteristics of problem solv- 
ing behavior. These characteristics are 
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behavior is continuous, and at any one 
time behavior consists of several habits. 
The terms “horizontal” and “vertical” are 
used to refer to these processes; horizontal 
to the continuity of behavior against the 
dimension of time, and vertical to the as- 
sumption that independent levels of be- 
havior (i.e, S-R units) occur simultane- 
ously. 

The assumption that S-R associations 
do not occur in isolation, but instead are 
linked together to form integrated, con- 
tinuous behavior goes back many years 
(e.g, Watson, 1913). Today the process 
is most commonly referred to as chaining. 
Skinner (1953) and his associates have 
developed powerful techniques that shape 
behavior into long, complicated chains. 
The mass of data they have collected 
suggests important principles governing 
habit chaining. There is little doubt that 
when their quasitheoretical system is ex- 
ploited fully with autoinstructional de- 
vices that important insights into prob- 
lem solving behavior will emerge, particu- 
larly in relation to how an added bit of 
knowledge can trigger problem solution. 
The kind of chaining with which the 
Skinnerians have dealt (i.e., adding new 
S-R units to an already functioning chain) 
does not exhaust all the problems asso- 
ciated with the horizontal processes of 
problem solving. Of particular importance 
to problem solving is the spontaneous 
integration of separate habits which oc- 
curs when an organism infers the conse- 
quences of combining previously inde- 
pendent S-R units. This kind of chaining 
was investigated in Kohler’s (1925) clas- 
sical studies of insight and in the more 
controlled reasoning experiments of 
Maier (1930). More recently the authors 
(Kendler & Kendler, 1956, 1961; Kendler, 
Kendler, Pliskoff, & D'Amato, 1958) have 
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tried to identify some of the important 
variables that enable children to combine 
separate experiences in order to solve an 
inference-type problem. Much of the re- 
search reported in this paper will be con- 
cerned with how mediated stimulus and 
response events aid in the formation of 
problem solving chains. 

The assumption, of vertical processes, 
i.e., the organism responds several differ- 
ent ways at any one time, is also not a 
novel one. Every psychologist is aware 
that organisms make several different re- 
sponses simultaneously, although typically 
only one is attended to. Sometimes the 
different responses are interrelated, as is 
the case between the heart and respira- 
tion rates of a fearful organism. In other 
cases the different responses are independ- 
ent, e.g., a person’s conversation is unin- 
fluenced by his tugging at his ear lobe. 
The best laboratory example of vertical 
processes, and one that has much rele- 
vance to problem solving, is shown in 
Figure 1. Those familiar with introduc- 
tory psychology textbooks will recognize 
this diagram as representing classical con- 
ditioning. Notice that the two solid lines 
indicate independent S-R units which are 
operating simultaneously. One is the tone 
that initiates the “investigatory” response, 
and the other is the food which elicits sali- 
vation. Initially these two associations 
operate in a parallel fashion, but as a re- 
sult of their simultaneous occurrence an 
interaction takes place which is expressed 
by the broken line representing the ac- 
quired conditioned response. 

Obviously the brief reference to hori- 
zontal and vertical processes in which it 
is assumed fundamental S-R principles 
operate (e.g, discrimination, generaliza- 
tion, etc.) presents at best the barest 
skeleton of a model of problem solving. 
It needs the flesh and skin of experi- 
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FIG. 1. An S-R representation of classical 
conditioning. From Kendler and Kendler: 
Vertical and horizontal processes in 
problem solving. 


solivation 


mental facts to give it solidity and theo- 
retical principles to clothe it in scientific 
respectability. Let us now review some of 
the progress that has been made in this 
direction. 


Concept Learning and Utilizaton 


Although the primitive model just de- 
scribed fails to generate any research by 
itself, it does suggest that individual ex- 
periments cannot be directed at problem 
solving in its entirety. There are too many 
aspects to this phenomenon. The re- 
searcher, in designing an experiment, 
must scan the entire problem solving 
process and then focus upon that seg- 
ment that promises to yield fruitful re- 
sults and is also amenable to investiga- 
tion. 

For reasons that will become evident, 
it was decided to compare reversal and 
nonreversal shifts in a simple concept 
learning task. Figure 2 characterizes each 
kind of shift by showing a simplified 
version of an experimental situation used 
with children. The stimuli (cups) for 
their first discrimination differed simul- 
taneously on two dimensions (size and 
brightness). The subject is rewarded for 
responses to one dimension (e.g., large 


cup is positive, small cup is negative). 
The other dimension is irrelevant. After 
learning the first discrimination, the sub- 
ject is forced to shift to another response. 
In a reversal shift the subject is required 
to respond to the same dimension on 
which he was originally trained, but his 
overt choice has to be reversed, e.g., he 
has to shift from a large cup to a small 
one. For a nonreversal shift the previously 
irrelevant dimension becomes relevant, 
e.g, black becomes positive after large 
had been positive. 

Buss (1953) reported that college stu- 
dents executed a reversal shift more 
rapidly than a nonreversal shift. He at- 
tributed this superiority to the intermit- 
tent reinforcements that retard the prog- 
ress of a nonreversal shift. For example, 
in Figure 2,2 when a subject is making a 
nonreversal shift from large positive to 
black positive, he is reinforced when 
choosing the large black cup in prefer- 
ence to the small white cup. This fortui- 
tous reinforcement of the choice of the 
large cup helps maintain the size dis- 
crimination and hence retards the learn- 
ing of the brightness discrimination. The 
reversal shift group, on the other hand, 
receives no reinforcement of the previ- 
ously correct responses, since they are 
100% nonreinforced. 

This analysis is at best incomplete. The 
work of Kendler and Vineberg (1954) 


2The purpose of Figure 2 is to clarify 
the meaning of both a reversal and non- 
reversal shift. It would be misleading to 
believe that it represents exactly the meth- 
odology of “reversal-nonreversal” studies 
reported in this paper. For all experiments 
reported, except that of Buss (1953), de- 
signs were used that controlled for fortui- 
tous intermittent reinforcements effects in 
a nonreversal shift. 
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FIG. 2. Examples of a reversal and a 
nonreversal shift, From Kendler and 
Kendler: Vertical and horizontal proc- 
esses in problem solving. 


suggested that adult human concept learn- 
ing cannot be represented adequately by 
a single-unit S-R theory in which the ex- 
ternal stimulus is directly connected to 
the overt response. Instead, a mediational 
mechanism (see Figure 3) is required 
which assumes that the external stimulus 
evokes an implicit response which pro- 
duces an implicit cue that is connected 
to the overt response. 

It would be useful to digress for a mo- 
ment to comment about the epistemo- 
logical status of these inferred stimulus 
and response events which are enclosed in 
the rectangle to emphasize their hypo- 
thetical character. Although not directly 
observable, they are “tied to” environ- 
mental and behavioral events. The basic 
assumption of the mediational hypothe- 
sis, at least for the time being, is that the 
implicit stimulus and response events 
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FIG. 3. A schematic representation of the 
mediational hypothesis. From Kendler 
and Kendler: Vertical and horizontal 
Processes in problem solving. 


obey the same principles that operate in 
observable S-R relationships. 

The mediational hypothesis has gen- 
erated confusion. Perhaps the following 
brief statements will clarify some possible 
areas of misunderstanding. 

l. The mediational hypothesis is 
neither new nor revolutionary. Meyer 
(1911) and Watson (1913) referred to 
it, and Hull (1930) gave it a more formal 
status by coining the concept of the “pure 
stimulus act.” Guthrie (1952) has always 
laid heavy stress on a mediational-type 
hypothesis when emphasizing the impor- 
tance of proprioceptive stimulation in 
learning. 

2. The implicit stimulus and response 
events need not be conceived as having 
an existence independent of their rela- 
tion to independent and dependent vari- 
bles. These implicit events are theoretical 
constructs. Their epistemological status 
is closer to such concepts as drive and 
habit than to directly observable stimulus 
and response events. 

Some mediating events can conceiv- 
ably and probably will be coordinated to 
introspective reports, language behavior, 
muscular movements, and other observ- 
able events. Coordinations of this sort can 
be useful in developing mediational 
theory. But such coordinations are not 
essential to mediational theory. The fact 
that genes are not directly observable (at 
least according to the geneticists con- 
sulted) does not interfere with their 


theoretical and practical usefulness, Even 
if it were possible to observe a gene di- 
rectly, it would be necessary to distinguish 
between it as an observable entity and 
as a concept within a nomological net- 
work. It would be unwise, and strategi- 
cally shortsighted, to identify mediational 
events with introspective reports or lan- 
guage behavior, or other observable 
events. The “valadity” of the mediational 
mechanism does not depend on being 
coordinated with observable events, but 
depends instead on being utilized in a suc- 
cessful explanatory system. 

Figure 4 characterizes reversal and non- 
reversal shifts in terms of both a single 
unit S-R analysis and a mediational one. 
It would be predicted, according to a 


3 Figure 4 highlights the problem of 
what are the effective stimuli that are as- 
sociated to the overt response in both a 
reversal and nonreversal shift. It is not 
intended to be a detailed analysis of which 
there may be several alternatives. For ex- 
ample, in a single unit theory the habit to 
choose the large container might result 
from learning two separate specific habits 
(e.g., the choice of a large black container 
when coupled with a small white one and 
the selection of a large white container 
when paired with a small black one). An- 
other possibility, which would be con- 
sistent with Spence’s theory (1936), is 
that the response is to the effective stimu- 
lus large since responses to the other fea- 
tures of the environment are not consist- 
ently reinforced. Similarly adult subjects 
in a reversal shift might use the mediator 
size or large or both. The effective stimulus 
which is controlling the organism’s re- 
sponse must be determined by experimen- 
tation. The point made here is that the 
general implications of the single unit and 
mediational theories, as discussed in this 
paper, would be the same for a number of 
different effective stimuli. 
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MEDIATIONAL THEORY 


single unit hypothesis, that if fortuitous 
intermittent reinforcements were elimi- 
nated from a nonreversal shift, it would 
occur more rapidly than reversal shift. 
The reason for this is that at the time of 
the shift the difference between the 
strength of the dominant incorrect habit 
and the to-be-correct habit is much greater 
for the reversal, as compared to the non- 
versal shift. Consequently more training 
will be required to make the correct habit 
dominant in a reversal shift. According to 
the mediational theory the situation is 
entirely different. A reversal shift enables 
the subject to utilize the same mediated 
response, Only the overt response has to 
be changed. A nonreversal shift, on the 
other hand, required the acquisition of a 
new mediated response, the cues of which 
have to be attached to a new overt re- 
sponse. Because the old mediational se- 
quence has to be discarded and a new 
one formed, the nonreversal shift should 
be executed more slowly than a reversal 


S 


size 


SHEE Ria 
\r S ee Rinit 


bright- bright- R 
black 


ness ness 
FIG. 4. A single unit and mediational 
S-R analysis of a reversal and nonreversal 
shift. From Kendler and Kendler: Verti- 
cal and horizontal processes in problem 
solving. 
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shift. Thus, if it were possible to elimi- 
nate fortuitous intermittent reinforce- 
ments, then the stage would be set for a 


4 There are two possible ways of analyz- 
ing the superiority of a reversal shift over 
a nonreversal shift within an S-R media- 
tional framework. One is to simply count 
the number of new associations that have 
to be formed. As Figure 4 indicates only 
one new association has to be formed in a 
reversal shift while two have to be formed 
for a nonreversal shift. Another possibility 
is that a mediating response is more diffi- 
cult to extinguish than is an overt re- 
sponse. For the present the formulation 
can remain open-ended until information 
relevant to these two alternatives is gath- 
ered. 
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crucial experiment testing the conflicting 
implications of the single-unit and media- 
tional S-R theories. The results of a series 
of such crucial experiments (Buss, 1956; 
Harrow & Friedman, 1958; Kendler & 
D’Amato, 1955) have been consistent 
with the mediational formulation in 
showing that college students execute a 
reversal shift more rapidly than a nonre- 
versal shift. It is important to note that 
in a similar kind of problem rats find a 
nonreversal shift easier than a reversal 
shift (Kelleher, 1956). Thus, one is forced 
to conclude that a single unit S-R theory 
accurately represents the behavior of rats, 
while mediational S-R theory is required 
for the concept learning of articulate hu- 
mans. 

The discontinuity between the behavior 
of rats and college students directs one’s 
attention toward the conditions respon- 
sible for the development of mediational 
processes. Somewhere on a hypothetical 
evolutionary dimension between the rat 
and college student there should be a 
point where a transition is made from a 
single unit to mediational control. An 
obvious place to locate this point would 
be in the behavior of young children. 

A study with kindergarten children 
(Kendler & Kendler, 1959) showed that 
these children as a group executed a 
reversal and nonreversal shift at approxi- 
mately the same rate. One might conclude 
that the point in human development 
was discovered which was psychologically 
halfway between the white rat and the 
college student, since the kindergarten 
children were neither responding in a 
single unit nor mediational manner, but 
instead in some compromise fashion. 
Another possibility is that the children 
had reached a transitional stage in de- 
velopment, in which the task to which 
they were subjected led some to function 


on a single unit basis, and others to op- 
erate with a mediational mechanism. If 
half of the subjects respond in each way, 
the total results would have revealed no 
difference between the two kinds of 
shifts, 

The second alternative seems to fit the 
data. When the kindergarten children 
were divided into fast and slow learners 
on the basis of their performance in the 
first problem (training discrimination), 
slow learners performed during the second 
problem (test discrimination) according 
to the single unit theory; like rats they 
found a nonreversal shift easier. Fast 
learners, on the other hand, performed 
in accordance with the mediational 
theory; like college students, they found 
a reversal shift easier. These results were 
interpreted as demonstrating that these 
kindergartners, taken as a group, were 
in the process of developing mediating 
responses relevant to this task, and that 
some were further along than others. 


TABLE 1 
Mean Number of Trials to Criterion 
on Test Discrimination for Subjects Scoring 
above and below the Median 
on the Training Discrimination 


PERFORMANCE ON TRAINING 
DISCRIMINATION 


Crop Above median Below median 
(slow learners) (fast learners) 
Reversal 24.4 6.0 
Nonreversal 9.0 15.5 


From Kendler and Kendler: Vertical and hori- 
zontal processes in problem solving. 


If this interpretation be correct, then 
it would follow that for a group of 


younger (i.e., preschool) children a still 
smaller proportion should develop ap- 
propriate mediating responses. It would 
be expected that such a group, taken as 
a whole, would show clearcut evidence 
of the superiority of a nonreversal over 
a reversal shift. An experiment (Kendler, 
Kendler, & Wells, 1960) designed to test 
this hypothesis produced results consist- 
ent with this prediction; like rats, nursery 
school children found a nonreversal shift 
to be easier than a reversal shift. 

In a very recent study the experimental 
procedure was modified so that after 
learning the initial discrimination, the 
children of 3, 4, 6, 8, and 10 years of age 
who served as subjects, had a choice of 
either responding in a reversal or a non- 
reversal manner. Under such circum- 
stances, it would be expected that the 
proportion of children who respond in a 
reversal manner would increase with age. 
Figure 5 shows that the percentage of 
children whose chose a reversal shift rose 
gradually from 37.5 at 3 to 62.5 at 10. 

Generalizing from all of these results, 
it would seem that in their early develop- 
ment, children tend to respond in a 
manner consistent with a single unit S-R 
theory. With age, they develop a tend- 
ency to respond in a mediational manner. 
The last study cited suggests that it is, or 
will soon be, possible to ascertain the 
lawful relationship governing the course 
of this development. 

The point of these experiments is not 
to classify children into one of two cate- 
gories: rat-like or human-like. Their aim 
is to lay the groundwork for experiments 
designed to investigate the mediational 
process itself. If one wants to investigate 
mediational processes, does it not seem 
sensible to scrutinize them at the time 
when they are developing? Answering this 
question in the affirmative, it was decided 
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FIG. 5. Percentage of children responding 
in a reversal shift manner as a function of 
age. From Kendler and Kendler: Vertical 
and horizontal processes in problem 
solving. 


to investigate the relationship between 
the hypothesized mediational processes 
and verbal behavior—a relationship every- 
body assumes to be intimate and im- 
portant. 

Particularly relevant to this attempt to 
coordinate verbalization with mediation 
were observations that during the course 
of the experiments just described, it was 
not uncommon for children to verbalize 
spontaneously the correct solution while 
simultaneously making an incorrect 
choice. A few children did this for many 
consecutive trials. This observation is rele- 
vant to the concept of vertical processes. 
Two chains of habits are occurring simul- 
taneously. One has to do with verbal re- 
sponse; the other with the overt choice. 
For these children the two chains are 
parallel, that is, they do not interact. 

Luria (1957), the Russian psycholo- 
gist, made somewhat similar observations 
in his research with children. He explains 
this sort of phenomenon in the following 
way: 
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In the early stages of child development, 
speech is only a means of communication 
with adults and other children. . . . Subse- 
quently it becomes also a means whereby he 
organizes his own experience and regulates 
his own actions. So the child’s activity is 
mediated through words (p. 116). 


These observations and their interpre- 
tations of noninteracting parallel processes 
point to the complex interrelationships 
existing between verbal behavior on the 
one hand and problem solving on the 
other. If nothing else, they destroy the 
illusion that it is reasonable to describe 
an organism as verbal or nonverbal with- 
out considering the problem with which 
it is confronted. The terms verbal and 
nonverbal become meaningful—and fruit- 
ful—when related to specific problem 
solving tasks. 

It would seem fruitful to investigate 
the cue function of words for children of 
two age levels. One possibility is that age 
influences problem solving only in so far 
as it leads to the acquisition of words. If 
younger children, say 4 years of age, could 
acquire the same words as 7-year-olds, 
they would solve a simple concept-learn- 
ing problem the same way. The other pos- 
sibility is that the acquisition of the verbal 
label by itself is not sufficient; the word 
must be integrated with other behavioral 
chains to influence problem solving be- 
havior. And for this to happen some de- 
velopmental changes must first take place, 

In order to test these two alternatives, 
children of 4 and 7 years of age were pre- 
sented with another variation of the re- 
versal shift problem as shown in Figure 
6. They initially learned a simple dis- 
crimination between a pair of stimuli that 
varied simultaneously in size and bright- 
ness. In the illustration provided in Fig- 
ure 6, the large black square is correct. 
While they were learning, the children 
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FIG. 6. The experimental procedure used 
to study the influence of verbal habits on 
a reversal shift. From Kendler and Kend- 


ler: Vertical and horizontal processes in 
problem solving. 


were required to verbalize aloud the stim- 
uli to which they were responding. One- 
third learned to say “large” (or “small” as 
the case may be) by the simple device of 
instructing them to tell the experimenter 
which was correct, the large or the small 
one. Another third learned to say “black” 
(or “white” ) in a corresponding way. The 
remaining third was not required to say 
anything. After learning the discrimina- 
tion, all subjects were presented with a 
reversal shift. In the example depicted in 
Figure 6, the shift is to small regardless 
of size. Thus, the group that initially de- 
scribed the correct stimulus as “large” 
had verbalized the relevant dimension. 
The verbal response of “black” was ir 
relevant to this reversal shift. 

Figure 7 shows the results of the three 
experimental groups for the two age 
levels. If developmental processes affect 
the utilization of verbal responses in prob- 
lem solving, then it would be expected 
that the three verbalization conditions 
(which produced a significant main ef- 
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FIG. 7. The effect of verbalizations on a 
shift for 4- and 7-year-old 
From Kendler and Kendler: 
and horizontal processes in 
solving. 
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fect) would influence the behavior of the 
two age groups differently. These results 
suggest, but not quite at a significant 
level, that there is an interaction effect: 
Figure 7 shows that the younger children 
profited by making the kind of verbal re- 
sponse appropriate to a reversal shift, 
while they were hindered by learning 
inappropriate verbal responses. With no 
verbalization the 7-year-old children who 
presumably were responding largely in a 
mediational manner, accomplished a re- 
versal shift much more rapidly than their 
younger counterparts. But unlike the 4- 
year-olds, they did not profit from being 
trained to make the relevant responses. 
At 7 years of age they are capable of mak- 
ing the response themselves and outside 
help appears to be of little use. In con- 
trast, the influence of irrelevant verbaliza- 
tions is marked. The performance of the 
7-year-olds was even poorer than that of 
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the 4-year-olds, suggesting that the inter- 
fering effects of being given an inappro- 
priate mediated response are greater 
when one is capable of spontaneously gen- 
erating the correct one (7-year-olds) than 
when one is not (4-year-olds). 

How are these data to be explained? 
Attributing differences to developmental 
factors is not sufficient. It is necessary to 
represent developmental differences in 
terms of the concepts of the behavior 
model that is being used. That is, if a 
verbal label for a young child does not 
possess the same cue function as it does 
for an older child, then it becomes neces- 
sary to specify how and why this comes 
about. To some extent this has been done 
by emphasizing the transition from a 
single unit to a mediational system, as 
well as suggesting that with age an in- 
crease occurs in interaction among chains 
of different vertical levels. But obviously 
this analysis of the developmental proc- 
ess demands further theoretical and em- 
pirical development. 

These studies are intimately related to 
the oft-reported finding that many species 
of subhuman animals are able to make a 
fairly rapid reversal shift if they receive a 
previous series of such shifts, Rats (Buy- 
tendijk, 1930; Krechevsky, 1932) show a 
marked improvement in executing suc- 
cessive reversals. They finally reach a 
point (Dufort, Guttman, & Kimble, 
1954), in a T maze, where they learn to 
go to a new rewarded goal after making 
only one error. Even more dramatic are 
the rapid discrimination reversals ex- 
hibited by Harlow’s (1949) monkeys. But 
fish (Wodinsky & Bitterman, 1957) ex- 
hibit only a slight improvement in suc- 
cessive reversals, while isopods (inverte- 
brates) show no improvement (Thomp- 
son, 1957). 

Because of the necessity to use some- 
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what different experimental procedures 
for different species, it is difficult to draw 
an unqualified conclusion about the abil- 
ity of different species to transfer what 
has been learned from previous reversal 
shifts to a new one. But the suggestion is 
strong that as you ascend the evolution- 
ary scale organisms acquire a greater Ca- 
pacity to generate cues that enable them 
to make rapid reversal shifts. This be- 
havior, according to our analysis, borders 
on the language responses of humans. The 
main difference is that our human sub- 
jects, except those of a very young age, 
exhibit rapid reversals without any previ- 
ous reversal training. Whereas the hu- 
man automatically seems to generate a 
mediated response that provides the basis 
for his rapid reversal, the animal subject 
must gradually acquire an ability to re- 
spond appropriately to some response 
produced cue resulting from nonreinforce- 
ment of a previously correct response. 
Up to now, the reversal and nonrever- 
sal technique has been used to investigate 
mediational and developmental variables. 
It has proved sufficiently flexible to be 
used in a study (Kendler, Glucksberg, & 
Keston, 1961) which was designed to 
lengthen a problem solving chain so that 
the interaction between various segments 
could be observed. In this study a per- 
ceptual orienting S-R unit was added on 
to the mediational chain already de- 
scribed. Figure 8 illustrates in an over- 
simplified manner the behavioral se- 
quence involved in this study in which 
subjects had to learn to press the correct 
button when two physically discrete and 


spatially separate stimulus patterns were 
projected on a screen at such a rapid rate 
that only one could be perceived on any 
trial. During the learning of each of two 
successive concepts (involving either a 
reversal or nonreversal shift), the subject 
had to pay attention to the relevant stim- 
ulus pattern while ignoring the irrelevant 
one. Thus, in order to make the correct 
overt response consistently, a subject in- 
itially had to make the appropriate orient- 
ing response in order to perceive the rele- 
vant stimulus pattern to which he had to 
make the correct mediational response 
which served as the cue for the key-press- 
ing act. 

An experimental design was used in 
which, at the time of the shift from the 
first to the second concept, one group 
had already learned the appropriate orient- 
ing response as well as the appropriate 
mediating act. They needed only to learn 
a new terminal key-pressing response. The 
shift, for them, was easy to make. In con- 
trast, the behavior of three other experi- 
mental groups was significantly worse. 
One group had to learn a new orienting 
response, e.g., look to the left instead of 
the right. Another group had to learn a 


FIG. 8. The hypothesized behavioral chain 
operating at the time the subject was 
being shifted to the ‘second concept. 
(Capital letters refer to directly obser- 
vable stimulus and response events, 
while small letters refer to those that are 
inferred.) From Kendler and Kendler: 
Vertical and horizontal processes in 
problem solving. 
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new mediated response (i.e., they were 
required to make a nonreversal shift). 
The last group had to acquire both a new 
orienting and mediated response. The 
fact that the groups which were missing 
one or both of the necessary behavior 
units (orienting and mediated responses) 
did not differ significantly among them- 
selves, as well as being much poorer than 
the group that had both, highlights the 
problems of synchronizing the S-R units 
in a behavioral chain. The advantage in 
this study of having one appropriate unit 
without the other is at best negligible. 
The reason for this is that reinforcement 
is only achieved consistently when both 
the appropriate orienting and mediating 
responses are operating. This particular 
study points to the need for discovering 
laws associated with the strengthening 
and weakening of independent S-R units 
in a problem solving chain, as well as the 
principles governing their synchroniza- 
tion. 

This study also highlighted a very basic 
problem in all of these reversal studies. 
This problem has to do with the very first 
correct response following the reversal 
shift. After discovering that the previ- 
ous mode of responding is erroneous, 
what makes the subject change his re- 
sponse, i.e., push the button that was pre- 
viously wrong? Introspective reports fail 
to provide any clearcut answer and even 
if they did they would be in need of ex- 
plaining (Kendler, 1961). 

One hypothesis is that the selection 
of the new correct response is due to the 
operation of a behavioral chain in addi- 
tion to the one described in Figure 8. The 
first nonreinforcement in a reversal shift 
sets off a chain, the consequence of which 
is to select the response other than the 
one that was previously correct. This may 
result from a number of different reasons 
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(e.g, logical considerations, forgetting, 
etc.). The important point, however, is 
that the new key-sorting response occurs 
contiguously with the implicit media- 
tional response appropriate to a reversal 
shift, As a result, a new association is 
formed between the old implicit cue and 
the new key-pressing response. 

In essence, what is being stated is that 
adult subjects, when making or deciding 
to make the first correct post-shift re- 
sponse, do not adopt the principle under- 
lying a reversal shift. Instead, it is as- 
sumed processes are operating which 
encourage the selection of the correct 
response while an implicit cue appropriate 
to a reversal shift is operating. This sort of 
an analysis was described previously 
(Kendler & Mayzner, 1956) as 


sort of a James-Lange theory of problem 
solving . . . one makes the overt correct . . . 
response and if the appropriate symbolic cue 
is present, then problem solution will occur 
(pp. 247-248). 


Guthrie (1959) says the same thing more 
neatly: “What is being noticed becomes 
a signal for what is being done” (p. 186). 

Again the authors would like to guard 
against giving the impression of over- 
simplifying a terribly complex problem. 
They do not believe the contiguous oc- 
currence of an implicit cue from one chain 
with the correct overt response from an- 
other tells the whole story. This new as- 
sociation in order to persist must be re- 
inforced and in some manner “fit into” 
the subject’s ongoing behavioral chains. 

The emphasis on this vertical connec- 
tion between a cue and a response from 
different chains is related in a distant way 
to Hebb’s (1958) stressing the role of 
“chance” in problem solving: 


There are few scientists who have not had 
the experience of setting out to solve prob- 
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lem A and ending up instead with the solu- 
tion to B. . . . This is serendipity, the art 


of finding one thing while looking for an- 
other (p. 215). 


According to the present analysis, ser- 
endipity results from the adventitious and 
contiguous occurrence of a cue and a re- 
sponse which are themselves segments 
from different behavior chains. Theoreti- 
cally it should be possible to demonstrate 
this point experimentally by training sub- 
jects to respond simultaneously to two 
separate tasks. A problem then would 
have to be presented that requires for 
its solution the combination of a stimu- 
lus from one chain with the response 
from the other. In such an experimental 
situation, controlling the time relation- 
ship between the two should have an im- 
portant effect on problem solving. Pre- 
sumably contiguity between the two 
should provide the most optimal condi- 
tions for problem solving (Underwood, 
1952). The development of this kind of 
experimental procedure should allow for 
parametric studies of the basic variables 
of the phenomenon which has commonly 
been called “insight,” as well as throw 
light upon issues raised by others (e.g. 
Cofer, 1957; Maltzman, 1955; Saugstad, 
1957). 

The pretheoretical model that guides 
the present research has many more facets 
that can be exploited. Only one will now 
be mentioned. Glucksberg (1962), for 
example, extended neobehavioristic drive 
theory (Spence, 1956) to problem solv- 
ing. He used a functional-fixedness prob- 
lem (Adamson, 1952; Duncker, 1945) in 
which the correct response in the habit 
hierarchy could either be made to be low 
or high. If the correct habit was low, it 
would be expected that a strong drive 
would retard problem solving because it 


would retard the extinction of the domi- 
nant incorrect response (Kendler & Lach- 
man, 1958; Perin, 1942). Since drive en- 
ergizes behavior, a high drive should facili- 
tate problem solving performance when 
the correct habit is dominant. The find- 
ings were consistent with this analysis, 

Because functional-fixedness problems 
are often represented in perceptual terms, 
Glucksberg was interested in seeing 
whether the same drive model could be 
applied to a simple perceptual recogni- 
tion problem in which subjects were in- 
structed to identify tachistoscopically pre- 
sented words as rapidly as possible. The 
results were similar to those reported for 
the functional-fixedness study: when the 
correct response was dominant, an in- 
crease in drive improved performance, 
ie, the visual duration threshold was 
lowered. In contrast, increasing drive 
when the correct response was low in the 
hierarchy raised the threshold. 

There is obviously still much more 
work, both empirical and theoretical, 
needed to develop the model that has 
been described. At this point it may be 
appropriate to summarize the major 
points of this paper. 

There is not just one way to investi- 
gate problem solving. The researcher who 
is interested in problem solving has sev- 
eral different pretheoretical models from 
which to choose. This paper reported the 
results of a research program based on an 
S-R model in which the importance of 
horizontal and vertical processes were em- 
phasized. Horizontal processes refer to 
the linking of successive S-R units into a 
behavioral chain, while vertical processes 
refer to the assumption that independent 
chains occur simultaneously. A series of 
experiments was reported, the implica- 
tions of which supported postulating a 


mediational mechanism within a behay- 
ioral chain. By comparing the behavior of 
human subjects of different ages, as well 
as relating their results to lower animals, 
it was possible to infer that as a child 
matures he makes a transition from re- 
sponding on the basis of a single unit 
S-R mechanism to a mediational one. Ad- 
ditional data were cited that suggest the 
full impact of verbal behavior on prob- 
lem solving depends on developmental 
processes that encourage interaction be- 
tween chains at different vertical levels. 
It was also suggested that problem solv- 
ing begins in a simple concept learning 
task when a correct overt response from 
one behavioral chain occurs contiguously 
and adventitiously with the appropriate 
implicit cue from another chain. The pa- 
per was concluded by citing findings that 
suggested the neobehavioristic drive the- 
ory which assumes that the effect of dif- 
ferent levels of drive depends on the posi- 
tion of the correct response in the habit 
hierarchy is applicable to a functional- 
fixedness problem as well as a perceptual- 
recognition task. 

If nothing else, it is hoped that the 
present paper demonstrates that it is pos- 
sible to investigate problem solving in a 
systematic fashion. If more psychologists 
accepted this possibility and were willing 
to expend their research energies in the 
field of problem solving, progress in this 
area would be greater than it is today. 


REFERENCES 


Adamson, R. E. Functional-fixedness as re- 
lated to problem solving. J. exp. Psychol., 
1952, 44, 288-291. 

Buss, A. H. Rigidity as a function of reversal 
and nonreversal shifts in the learning of 
successive discrimination. J. exp. Psychol., 
1953, 45, 75-81. 


PROBLEM SOLVING 


257 


Buss, A. H. Reversal and nonreversal shifts 
in concept formation with partial rein- 
forcement eliminated. J. exp. Psychol., 
1956, 52, 162-166. 

Buytendijk, F. J. J. Uber das Umlernen. 
Arch. Néerl. Physiol., 1930, 15, 283-310. 

Cofer, C. N. Reasoning as an associative 
process: III. The role of verbal responses 
in problem solving. J. gen. Psychol., 1957, 
57, 55-58. 

Dufort, R. H., Guttman, N., & Kimble, 
G. A. One trial discrimination reversal in 
the white rat. J. comp. physiol. Psychol., 
1954, 47, 248-249. 

Duncker, K. On problem solving. Psychol. 
Monog., 1945, 58 (5, Whole No. 270). 
Glucksberg, S. The influence of strength of 
drive on functional fixedness and percep- 
tual recognition. J. exp. Psychol., 1962, 

in press. 

Guthrie, E. R. The psychology of learning. 
(Rev. ed.) New York: Harper, 1952. 

Guthrie, E. R. Association by contiguity. 
In S. Koch (Ed.), Psychology: A study 
of a science. Vol. 2. New York: McGraw- 
Hill, 1959. Pp. 158-195. 

Harlow, H. F. The formation of learning 
sets. Psychol. Rev., 1949, 56, 51-65. 

Harrow, M., & Friedman, G. B. Comparing 
reversal and nonreversal shifts in concept 
formation with partial reinforcement con- 
trolled. J. exp. Psychol., 1958, 55, 592- 
597. 

Hebb, D. O. A textbook of psychology. 
Philadelphia: Saunders, 1958. 

Hull, C. L. Knowledge and purpose as habit 
mechanisms. Psychol. Rev., 1930, 37, 
511-525. 

Kelleher, R. T. Discrimination learning as a 
function of reversal and nonreversal shifts. 
J. exp. Psychol., 1956, 51, 379-384. 

Kendler, H. H. Problems in problem solving 
research. In, Current trends in psychologi- 
cal theory: A bicentennial program. Pitts- 
burgh: Univer. Pittsburgh Press, 1961. 

Kendler, H. H., & D’Amato, M. F. A com- 
parison of reversal shifts and nonreversal 
shifts in human concept formation be- 
havior. J. exp. Psychol., 1955, 49, 165- 
174. 


258 Problem Solving 

Kendler, H. H., Gluckesberg, S., & Keston, 
R. Perception and mediation in concept 
learning. J. exp. Psychol., 1961, 61, 186- 
191; 


Kendler, H. H., & Kendler, T. S. Inferential 
behavior in preschool children. J. exp. 
Psychol., 1956, 51, 311-314. 

Kendler, H. H., Kendler, T. S., Pliskoff, S. 
S., & D'Amato, M. F. Inferential behavior 
in children: I. The influence of reinforce- 
ment and incentive motivation. J. exp. 
Psychol., 1958, 55, 207-212. 

Kendler, H. H., & Lachman, R. Habit re- 
versal as a function of schedule of rein- 
forcement and drive strength. J. exp. Psy- 
chol., 1958, 55, 584-591. 

Kendler, H. H., & Mayzner, M. S., Jr. Re- 
versal and nonreversal shifts in card sort- 
ing tests with two or four sorting cate- 
gories. J. exp. Psychol., 1956, 51, 244-248. 

Kendler, H. H., & Vineberg, R. The acqui- 
sition of compound concepts as a function 
of previous training. J. exp. Psychol., 1954, 
48, 252-258, 

Kendler, T. S., & Kendler, H. H. Reversal 
and nonreversal shifts in kindergarten 
ae J. exp. Psychol., 1959, 58, 56- 


Kendler, T. S., & Kendler, H. H. Inferential 
behavior in children: II. The influence of 
order of presentation. J. exp. Psychol., 
1961, 61, 442-448. 

Kendler, T. S., Kendler, H. H., & Wells, D. 
Reversal and nonreversal shifts in nursery 
school children. J. comp. physiol. Psychol, 
1960, 53, 83-88. 

Kohler, W. The mentality of apes. New 
York: Harcourt, Brace, 1925. 

Krechevsky, I. Antagonistic visual discrimi- 
nation habits in the white rat. J. comp. 
Psychol., 1932, 14, 263-277. 


Luria, A. R. The role of language in the 
formation of temporary connections. In 
B. Simon (Ed.), Psychology in the Soviet 
Union. Stanford: Stanford Univer. Press, 
1957. Pp. 115-129. 

Maier, N. R. F. Reasoning in humans: I, 
On direction. J. comp. Psychol., 1930, 
10, 115-143. 

Maltzman, I. Thinking: From a behavioristic 
point of view. Psychol. Rev., 1955, 62, 
275-286. 

Meyer, M. F. The fundamental laws of 
human behavior. Boston: Gorham, 1911. 

Perin, C. T. Behavior potentiality as a joint 
function of the amount of training and 
the degree of hunger at the time of extinc- 
tion. J. exp. Psychol., 1942, 30, 93-113. 

Saugstad, P. An analysis of Maier's pen- 
dulum problem. J. exp. Psychol., 1957, 
54, 168-179. 

Skinner, B. F. Science and human behavior. 
New York: Macmillan, 1953. 

Spence, K. W. The nature of discrimination 
learning in animals. Psychol. Rev., 1936, 
43, 427-449. 

Spence, K. W. Behavior theory and condi- 
tioning. New Haven: Yale Univer. Press, 
1956. 

Thompson, R. Successive reversal of a posi- 
tion habit in an invertebrate. Science, 
1957, 126, 163-164. 

Underwood, B. J. An orientation for research 
on thinking. Psychol. Rev., 1952, 59, 209- 
220. 


Watson, J. B. Psychology as the behaviorist 
sees it. Psychol. Rev., 1913, 20, 158-177. 

Wodinsky, J., & Bitterman, M. E. Discrimi- 
nation-reversal in the fish. Amer. J. Psy- 
chol., 1957, 70, 569-575. 


ON THE TRAINING OF ORIGINALITY 


259 


25. 
On the Training of Originality*’ 


Irving Maltzman 


There has been a growing research 
interest in originality during the last dec- 
ade. Areas of major concern have been 
the study of the productivity of creative 
individuals (Dennis, 1958; Lehman, 1953; 
Taylor, 1956, 1958; Van Zelst & Kerr, 
1951), their personality (Barron, 1955; 
Drevdahl, 1956; Taylor, 1956, 1958), the 
sociological and cultural factors promot- 
ing creativity (Barnett, 1953, Stein, 1953; 
Taylor, 1956, 1958), and investigations 
designed to develop reliable paper and 
pencil tests for the study of individual 
differences (Guilford, 1950; Springbett, 
Dark, & Clarke, 1957; Wilson, Guilford, 
& Christensen, 1953) ? 

Although there is general recognition 
of the importance of the problem of de- 
vising training techniques for facilitating 
creativity, most of the work in this impor- 


* From I. Maltzman, On the training of 
originality, Psychol. Rev., 67, 229-242 
(1960). Reprinted by permission of the 
author and the American Psychological 
Association. 

1 This work was supported by contract 
Nonr 233(50) between the Office of 
Naval Research and the University of 
California, Reproduction in whole or in 
part is permitted for any purpose of the 
United States Government. 


tant area has been anecdotal or merely 
hortatory (Ghiselin, 1955; Mearns, 1958; 
Osborn, 1957; Slosson & Downey, 1922). 


Scope of This Paper 


The purpose of this paper is to review 
the experimental research that may be 
relevant to the problem of devising tech- 
niques for increasing originality and to 
indicate the behavioral principles possibly 
involved in the production of the desired 
effect. 

For purposes of further discussion we 
shall distinguish between originality and 
creativity. Originality, or original think- 
ing, as we shall use the term, refers to 
behavior which occurs relatively infre- 
quently, is uncommon under given 
conditions, and is relevant to those condi- 
tions. Criteria of relevance and uncom- 
monness, of course, must be established 
for any given situation. This is a problem 
more readily solvable within the labora- 
tory than without. Creativity, according 
to the present usage, refers to products of 
such behavior and the reactions of other 
members of a society to those products. 
An invention is a creative product that 
may have an important effect upon so- 
ciety and is a consequence of original be- 


2 These are only selected references and 
are not intended as an exhaustive survey of 
the relevant literature. A more complete 
list of references on originality may be 
found in Taylor (1956, 1958). 
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havior. But considerably more variables 
enter into the determination of creative 
works than originality alone. Our distinc- 
tion implies that an individual may be 
highly original but not creative. His bril- 
liant theories are never published, or they 
are not implemented by the necessary 
research. Perhaps the original research is 
conducted, but the results are not pub- 
lished or patented. All this may be done, 
but the work may be overlooked or the 
implications disregarded by the appropri- 
ate community of scholars or society at 
large. Further common illustrations may 
be given, indicating that a great many 
more behavioral and societal variables in- 
fluence creativity than originality, making 
the study of originality under simplified 
laboratory conditions more feasible than 
that of creativity. Many of these variables 
may affect original behavior as well, but 
they are not of such overwhelming im- 
portance when the training of originality 
is considered. Our subsequent discussion 
therefore will be concerned solely with 
originality as here defined. One further 
distinction in the experimental study of 
original behavior needs to be made. Such 
behavior is always relative, either to a 
given ‘individual's past behavior or to the 
norms of a population of which he is a 
member (Barron, 1955). The two are no 
doubt correlated. But it is the latter which 
is related to creative works; and since all 
of the pertinent experimental research has 
been of this kind, we shall be concerned 
only with the study of originality relative 
to some group norm. 

Guilford (1959) also distinguishes be- 
tween originality and creativity. However, 
the basis for the distinction stems from 
his factor analytic approach. Originality, 
defined essentially in the same fashion as 
in the present paper, is one of several be- 
havioral traits contributing to creativity. 


The latter is a more general behavioral 
trait including as components several 
forms of flexibility, fluency, and motiva- 
tional and temperamental traits in addi- 
tion to originality. Although this is a 
reasonable empirical classification of traits 
based upon factor analysis, it does not 
necessarily contradict the present one. 
We do not, however, accept Guilford’s 
additional assertion that an S-R approach 
cannot deal adequately with creativity, 


Earlier Accounts of Originality Training 


Although psychologists have done rela- 
tively little experimental research on the 
training of originality, nonpsychologists 
have been concerned with the problem 
for some time. What is more, their sug- 
gestions, although not supported by evi- 
dence meeting the usual scientific stand- 
ards, are frequently in accord with 
commonly accepted behavioral principles. 

For example, Mearns (1958) in a book 
originally published in 1929 repeatedly 
emphasizes that in order to facilitate the 
originality of school children in the arts 
the teacher must reinforce, manifestly ap- 
prove, his original efforts. He illustrates 
many techniques for inducing the child 
to make public his efforts, to gain the 
confidence of children so that communi- 
cation will occur with their “secret unex- 
pressed selves.” Furthermore, the teacher 
is advised to approve of only the genu- 
inely original effort. The teacher is further 
cautioned to wait patiently for the ap- 
pearance of original behavior which is 
fostered by a “permissive atmosphere,” 
the absence of “drill” and excessive disci- 
pline. According to Mearns, original be- 
havior appears eventually because all 
normal children have an urge, energy, OT 
impulse to be creative. 

Aside from the romantic approach to a 
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problem of behavior, we would agree that 
the way to foster originality is to reinforce 
such behavior when it occurs. A basic 
difficulty is that it may not occur at all or 
at such infrequent intervals that the rein- 
forcements cannot shape up such behav- 
ior. Thus the fundamental problem in the 
training of originality is to devise methods 
for increasing its occurrence in diverse 
situations, is to get it to occur in the first 
place, thereby permitting the operation of 
reinforcement. If the operant level of 
originality is too low, conditioning will 
not be effective, training cannot occur. 
We are assuming, then, that originality 
can be learned and that the same princi- 
ples of conditioning hold as in other 
forms of operant behavior. Once it occurs 
it can be reinforced, approved, recognized. 
It will then show an increased probability 
of occurrence. An apparent difficulty, 
however, is that originality is manifestly 
different from other behaviors. How can 
the reinforcement of one bit of uncom- 
mon behavior increase the frequency of 
other uncommon behaviors which by 
definition are different. Despite the ap- 
parent paradox, this sort of nonspecific 
transfer does occur, as we shall see. 

Royce (1898), as far as we know, was 
the first to experimentally attack the prob- 
lem of devising techniques for facilitating 
the occurrence of originality. He em- 
ployed two different procedures. First, Ss 
were asked to draw a series of nonsense 
figures unlike anything they had ever 
seen. A second procedure was to present a 
series of drawings to S with instructions to 
draw figures as different as possible from 
each of the models. Examination of the 
qualitative changes that occurred under 
these conditions led Royce to conclude 
that these procedures may facilitate origi- 
nality and that they correspond to condi- 
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tions in society that are conducive to 
originality. 

Slosson and Downey (1922) suggest 
another method for training and testing 
originality in writing fiction. They suggest 
writing a plot, characters, or an entire 
story, based upon the more unusual mes- 
sages found in the personal columns of 
newspapers. Headlines are also proposed 
as training materials. Variations are pos- 
sible in the use of the materials by placing 
restrictions on the kind of plot or charac- 
ters to be invented. Thus, given an un- 
usual message, the writer is forced to prac- 
tice literary invention. The assumption is 
that this form of “mental gymnastics” will 
increase the originality of his writing. 

A simple test of originality suggested by 
Slosson and Downey (1922) is to deter- 
mine how many different plots can be 
written to the same message, and for how 
many messages can plots be written in a 
given time interval. A more formalized 
test is also presented, but no empirical 
data are given from its use. Likewise, no 
data are presented on the effectiveness of 
the training method which appears to 
have been employed as a teaching tech- 
nique in creative writing courses at the 
college level. 

Osborn (1957) also believes that origi- 
nality can be trained and that practice in 
producing original “ideas” will further de- 
velop originality. He gives many exercises 
designed to provide such training. They 
typically consist of various kinds of prob- 
lem situations for which as many different 
solutions as possible are to be offered. The 
quantity of different “ideas” is stressed, 
since it is believed that the likelihood of 
original “ideas” increases with increases in 
quantity. 

Osborn (1957) has also initiated a pro- 
cedure of “group ideation” known as 
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“brainstorming” which is designed to 
evoke original “ideas,” and which has re- 
ceived considerable attention from the 
public press. It is a modified group free 
association procedure with emphasis upon 
producing large numbers of “ideas” in the 
absence of criticism or judgments as to 
their value. Critical evaluation of “brain- 
storming” sessions occurs later in order to 
avoid inhibiting unusual “ideas” during 
the session. 

Although there have been courses 
established to teach “brainstorming” in 
business and industrial firms as well as 
colleges, there is as yet little objective re- 
search demonstrating its efficacy. 

Taylor, Berry, and Block (1957) found 
that group brainstorming did not produce 
a greater number of “ideas” or unique 
“ideas” as compared to individuals work- 
ing alone and whose performance was 
scored as a nominal group. In fact, it was 
found that the nominal groups were sig- 
nificantly superior to the brainstorming 
groups under the conditions of their ex- 
periment. Corroborative evidence was 
found in another study by Taylor and 
Block (1957). These experiments, how- 
ever, were not designed to study the ef- 
fects of originality training in groups or 
by individuals. They provide no informa- 
tion on the problem of training origi- 
nality, whether giving many different solu- 
tions to problems results in an increased 
probability of giving original solutions to 
subsequent different problems. 

Meadow and Parnes (1959) have re- 
cently reported that a course based upon 
the principles described in Osborn’s book 
(1957) produced a significant increment 
in originality in its students as compared 
to a control class taking a different course. 
But as in many classroom experiments, 
there is the difficulty of assessing what the 


relevant variables are, whether it was the 
training in problem solving per se, or the 
changes in motivation resulting from par- 
ticipating in a class and studying a pro- 
cedure which explicitly claims to facilitate 
problem solving. There are additional dif- 
ficulties inherent in the study since no 
attempt was made to control or assess the 
extent of differential rehearsal of the test 
materials in experimental and control 
classes. The experimental class practiced 
on materials very similar to the originality 
tests given before and after the courses 
were taken. Finally, the design employed 
permits a biased sampling of Ss, since the 
“creative problem solving” course was an 
elective one. 

The early psychological literature as 
well as the suggestions of the nonpsychol- 
ogists reviewed tend to agree upon a small 
number of different procedures for in- 
creasing originality. One training proce- 
dure is to present an uncommon stimulus 
situation, a situation for which common 
or conventional responses may not be 
readily available. Relatively uncommon 
responses may be evoked as a consequence 
(Slosson & Downey, 1922; Osborn, 1957). 
A second procedure is the evocation of 
different responses to the same stimulus 
situation (Royce, 1898; Osborn, 1957). 
Under such conditions the successive re- 
sponses may become more uncommon. A 
third training procedure is the evocation 
of the uncommon responses as textual 
responses. Several recent experiments 
have employed this procedure (Judson, 
Cofer, & Gelfand, 1956; Maltzman, 
Brooks, Bogartz, & Summers, 1958; Maltz- 
man, Simon, Raskin, & Licht, 1960) and 
will be discussed shortly. Instructions, as 
distinguished from training, may also be 
used to increase originality, and appear to 
be effective under certain conditions 
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(Christensen, Guilford, & Wilson, 1957; 
Maltzman, Bogartz, & Breger, 1958; 
Royce, 1898). 


“Productive” Thinking and Originality 


Before turning to the current experi- 
mental research on originality training, 
however, note should be taken of several 
recent studies that have employed Maier’s 
(1931) two-string or analogous problems 
as a test situation. The reason for com- 
menting upon these studies is the as- 
sumption that there is no fundamental 
difference in the behavioral principles de- 
termining originality and problem solving 
behavior generally. Both involve the evo- 
cation of relatively uncommon responses, 
otherwise the situation would not be 
called a problem or the behavior original. 
This is especially apparent in connection 
with Maier’s two-string problem. Maier 
(1931) considers the pendulum solution 
to be a consequence of productive think- 
ing whereas other solutions represent re- 
productive thinking. As indicated else- 
where (Maltzman, 1955) these problem 
solving behaviors do not involve funda- 
mentally different laws as demanded by 
Maier, but only a difference in the extent 
to which initial response hierarchies are 
modified. Furthermore, as far as can be 
determined this also is the basis that 
Maier used for distinguishing reproduc- 
tive from productive solutions. The for- 
mer solutions were given by his Ss upon 
the initial presentation of the problem. 
Only after these solutions were given and 
the Ss were told to find still another solu- 
tion, which happened to be the pendulum 
solution, did Maier call it productive 
thinking. The empirical basis for the dis- 
tinction between reproductive and pro- 
ductive thinking, then, was the proba- 
bility of occurrence of the solution under 
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his experimental conditions. The pendu- 
lum solution was relatively uncommon 
and is original in this sense. 

Several studies have attempted to deter- 
mine, with some success, whether verbal 
responses necessary for the solution of a 
subsequent problem are present in the 
initial response hierarchy of Ss (Saugstad, 
1955; Saugstad & Raaheim, 1957; Staats, 
1957). The determination is made by ob- 
taining word associations to objects later 
found in the problem situation. Responses 
necessary for the solution of the problem 
are presumably uncommon, have a low 
probability of occurrence in the initial 
response hierarchy. An association pro- 
cedure has also been used to determine 
the uncommonness of responses evoked 
in the initial response hierarchy and their 
relation to subsequent success in the two- 
string problem (Maltzman, Brooks, 
Bogartz, & Summers, 1958). 

A series of experiments by Judson, 
Cofer, and Gelfand (1956) is a limiting 
case of the use of textual responses in 
facilitating “productive” problem solving 
or originality. They employed the two- 
string problem as the test and rote learn- 
ing as the training situation. Instead of 
attempting to increase the occurrence of 
uncommon responses during training and 
determining their transfer effects in the 
test situation, they induced directly the 
response chain necessary for a pendulum 
solution to the problem. A group form of 
the two-string problem was employed, 
and the Ss were required to write as many 
solutions as possible to the problem of 
grasping both strings simultaneously. The 
design of the experiment was to prompt 
a pendulum solution to the problem by 
presenting an experimental group with 
different lists of words, one of which con- 
tained the relevant response chain “rope,” 
“swing,” “pendulum.” Additional control 
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group were employed receiving word lists 
including none of these words, one or all 
three but each in a different list. In this 
study as well as in two replications, the 
experimental group was superior to the 
control groups, although the differences 
were not always statistically significant. A 
further qualification is that these results 
hold only for men. No reliable differences 
were obtained among women in the vari- 
ous conditions. An analogous experiment 
was conducted employing a group form 
of Maier’s hat rack problem, and compara- 
ble results were obtained. These studies 
suggest that repeated evocation of the 
critical words during rote learning in- 
creased the probability of their occurrence 
in the problem situation which in turn 
lead to an increased frequency of the 
desired problem solution. 

Another related study has been re- 
ported by Flavell, Cooper, and Loiselle 
(1958). Their study was designed to dem- 
onstrate that “functional fixedness” could 
be reduced by evoking uncommon re- 
sponses to an object during a pretest 
period. In one respect it is more pertinent 
to the problem of producing relatively 
nonspecific transfer than the studies by 
Judson, Cofer, and Gelfand (1956), be- 
cause the responses evoked during the 
pretest period were not the appropriate 
ones in the subsequent test problem. 
However, for our purposes the experiment 
suffers the limitation that it does not 
show an actual facilitation of problem 
solving performance but only a reduction 
in “functional fixedness.” 

A series of studies by Maltzman, 
Brooks, Bogartz, and Summers (1958) 
combines features of both of these experi- 
ments (Judson et al., 1956; Flavell et al., 
1958) by evoking uncommon textual re- 
sponses during a pretest period which are 
not involved in the problem solution in 


any obvious manner. Evidence of facilita- 
tion was obtained under these conditions, 
A screwdriver and a block of balsa wood 
were the objects available for use in the 
problem situation. Only the screwdriver 
was sufficiently heavy to serve as a weight 
permitting a string to swing in pendulum 
fashion. In the first experiment a control 
group was given the test problem without 
any pretraining. Lists of unusual uses for 
a screwdriver, balsa wood, and string were 
read by the experimental group before 
they performed in the problem situation. 
None of the uses referred to operations 
involved in the experiment. It was never- 
theless found that the experimental group 
solved the problem significantly faster 
than the control group, and these results 
held for both sex groups. Additional ex- 
periments with modifications in the lists 
of unusual uses also obtained reliable dif- 
ferences between experimental and con- 
trol Ss, but typically in the case of women 
and not the men. Many variables in this 
experimental situation are in need of fur- 
ther analysis. However, the inherent lack 
of reliability of the two-string problem as 
a test and the difficulties involved in 
obtaining experimental control over the 
relevant variables in the situation suggest 
that more fruitful studies of originality 
and problem solving generally should em- 
ploy another type of experimental situa- 
tion. Also, with respect to the study of 
originality, test problems of this sort usu- 
ally involve uncommonness of response 
only by inference or by definition. A more 
direct measure of originality would be 
highly desirable. 


Current Studies of Originality Training 


Because they seemed to meet the de- 
sired requirements, tests of originality of 
the kind developed by Guilford (1950) 
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and his associates (Wilson, Guilford, & 
Christensen, 1953) as well as earlier 
writers (Hargreaves, 1927; Slosson & 
Downey, 1922) were chosen for a more 
detailed experimental analysis of variables 
involved in training originality by Maltz- 
man and his associates (1958, 1960). 

In the first experiment in this series 
(Maltzman, Bogartz, & Breger, 1958) the 
Ss were run individually. All of the subse- 
quent studies were conducted in group 
form. A modified free association proce- 
dure was employed in which the stimulus 
words were selected on the basis of their 
restricted response hierarchies. Since a 
relatively small number of different re- 
sponses are evoked by the stimuli, a high 
degree of communality occurs among 
their responses. A control group received 
an initial list of 25 words to which they 
gave free associations and a different final 
list of 25 words to which they gave free 
associations. This was followed by the 
Unusual Uses Test of originality (Guil- 
ford, 1950). The latter test consists of a 
series of names of six common objects for 
which S must give different uses other 
than their common everyday use. 

An experimental group received the 
same treatment except that the initial list 
was presented five additional times with 
instructions to give a different response on 
each repetition. A second experimental 
group was treated in the same fashion ex- 
cept that E said “good” after every ap- 
proximately fifth uncommon response 
during training. Each of these three 
groups was subdivided prior to the intro- 
duction of the free association test list. 
Half the Ss in each condition were in- 
structed to try to be as original as possible, 
and half were told nothing. Each of these 
subgroups were further subdivided prior 
to administration of the Unusual Uses 


265 


Test and instructed to be as original as 
possible. These latter instructions may 
have been redundant, if not confusing, 
since the written instructions to the test 
already implied as much. 

Originality measures were obtained for 
performance on the free association list 
by determining the frequency with which 
the responses to each stimulus word oc- 
curred. The mean frequency of his asso- 
ciative responses was taken as each S's 
originality score. Thus the lower the score 
the more uncommon are S’s responses on 
the average. The total number of unique 
responses given to the items was taken as 
the measure of originality on the Unusual 
Uses Test, where a unique response was 
defined as a use occurring only once in 
the sample. Results of the experiment 
showed that both training and instruc- 
tions produced a significant increase in 
originality on the free association test list. 
What is more, the experimental sub- 
groups receiving training in addition to 
instructions were significantly more origi- 
nal than the control group receiving in- 
structions alone, indicating that the train- 
ing may produce its effects independently 
of instructions to be original. Results ob- 
tained from the Unusual Uses Test were 
ambiguous, yielding a significant triple 
order interaction where the experimental 
subgroup without originality instructions 
was significantly more original than its 
control group. However, results on the 
Unusual Uses Test from subsequent ex- 
periments have consistently shown relia- 
ble training effects. 

Despite the above evidence indicating 
that the training procedure facilitated 
originality, additional information is 
needed to determine precisely what char- 
acteristics of the procedure are responsible 
for the effect. Differences between the ex- 
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perimental and control groups may have 
been due to the difference in number of 
stimulus words presented, number of re- 
sponses evoked, number of different re- 
sponses evoked, etc. The fact that differ- 
ent responses were evoked by the same 
stimuli may be neither necessary nor suffi- 
cient for an effective training method. 
Additional research was therefore con- 
ducted in an attempt to isolate the rele- 
vant variables. 

In one study (Maltzman et al., 1960) 
the control condition and the experi- 
mental condition without verbal rein- 
forcement or instructions to be original 
were again employed. The latter group 
received instructions to give a different 
response to each presentation of the same 
stimulus word. For convenience they will 
be called the standard control and experi- 
mental conditions, respectively. Two addi- 
tional experimental groups received lists 
of 125 different stimulus words, the same 
number as the repetitions of the initial 
list for the standard experimental group. 
One group received high frequency count 
stimulus words while the other group was 
presented with relatively low frequency 
count words (Thorndike & Lorge, 1944). 
This procedure equated the experimental 
groups for the total number of different 
tesponses. They differed in that the re- 
sponses all occurred to different stimulus 
words in the new experimental conditions 
whereas different responses occurred to 
the same stimulus words in the standard 
experimental condition. Another control 
group was added which received the same 
number of repetitions of the initial list as 
did the standard experimental group, but 
these Ss were instructed to try to give the 
same response at each repetition of a 
given stimulus. This condition would aid 
in determining whether the number of 
responses per se, or the number of differ- 
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ent responses, is the relevant variable in- 
fluencing test performance. 

Results from the free association test 
of originality showed that the three experi- 
mental groups did not differ significantly 
from each other and the two control 
groups did not differ significantly. But 
each of the experimental groups was sig- 
nificantly more original than each of the 
control groups. On the Unusual Uses Test 
the standard experimental group did sig- 
nificantly better than all the other groups. 
The two experimental groups receiving 
different stimulus words during training 
did not differ from the standard control 
group, while the new control condition 
was significantly less original than each of 
the other conditions. 

The results from this experiment indi- 
cate that under some conditions the 
evocation of a relatively large number of 
different responses to different stimuli 
may increase originality to the same ex- 
tent as the method of repeated evocation 
of different responses to the same stimuli. 
However, the two methods apparently 
differ in the extent to which they produce 
transfer effects, as indicated by the sig- 
nificant difference between the two meth- 
ods on the Unusual Uses Test. These re- 
sults show that the evocation of different 
responses to the same stimuli is an im- 
portant aspect of the standard experi- 
mental procedure, although arousal of 
many different responses by different 
stimuli is also effective, within limits. 

The significant loss of originality by 
the new control group was not entirely 
unexpected, and shows that a training 
technique can significantly decrease as 
well as increase originality, a result which 
is of theoretical interest as well as sug- 
gestive for classroom practices. Exactly 
why the effect should appear on the Un- 
usual Uses Test and not on the preceding 


ON THE TRAINING OF ORIGINALITY 


free association test is not clear, and is a 
problem that requires further experi- 
mental investigation. 

Another experiment (Maltzman et al., 
1960) was designed to further explore 
possible relevant variables and alternative 
procedures for facilitating originality. 

The standard control and experimental 
conditions were again employed. Another 
experimental condition was given repeated 
presentation of items from the Unusual 
Uses Test in order to determine whether 
the effectiveness of the training procedure 
is limited to only certain kinds of ma- 
terials. This was accomplished by present- 
ing the list of six items a total of six times 
with instructions to give a different use 
prior to each repetition. A different kind 
of training procedure was employed with 
a third experimental group. They were 
presented with a booklet consisting of 125 
different pairs of words. The Ss were in- 
structed to indicate the member of each 
pair which goes more readily with the 
stimulus word orally presented to them. 
The same stimulus words and number of 
repetitions as employed with the standard 
experimental conditions were adminis- 
tered. Each pair of words were unique 
responses to the stimulus words selected 
from the previously established norms. A 
fourth experimental group was given the 
word pairs and asked to indicate which 
member of each pair they thought to be 
more familiar. The stimulus words were 
not presented. Results of the free associa- 
tion and Unusual Uses Tests showed that 
the standard experimental condition was 
significantly more original than the other 
four groups on both tests, while the other 
groups did not differ significantly from 
each other. 

In one of the new conditions uncom- 
mon responses were evoked as textual re- 
sponses following the stimulus words. In 
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the other condition only the textual re- 
sponses occurred. These conditions were 
introduced in order to determine whether 
the uncommon responses must be evoked 
by the stimulus words in order for the 
training to be effective. The fact that 
these groups were significantly less original 
than the standard experimental group 
suggests that, at least with the training 
and test materials employed, uncommon 
responses must be evoked as intraverbal 
responses by the stimulus words if there 
is to be an increase in originality in the 
test situations. 

Since the experimental condition which 
received original training with items from 
the Unusual Uses Test failed to show a 
significant training effect, another experi- 
ment was conducted to determine 
whether the failure was due to an inade- 
quate amount of training. Four conditions 
were employed in this study receiving 
different amounts of training. None of 
the groups showed a significant increase 
in originality on the free association test 
when compared with the standard control 
condition. 

Results from the latter experiment and 
one condition from the previous experi- 
ment showed that training with unusual 
uses items in the same fashion as word 
association materials does not produce a 
comparable increase in originality. Thus 
the method of repeated evocation of dif- 
ferent responses to the same stimuli does 
not work with all materials. 

A basic assumption of our approach is 
that, if original behavior can be induced 
to occur repeatedly through some training 
procedure, it will increase in its frequency 
of occurrence in new situations. If this 
condition is not met, transfer of origi- 
nality to new situations cannot occur. In- 
spection of the unusual uses training data 
indicated that an appreciable increase in 
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originality did not occur during training. 
In the case of training with free associa- 
tion materials a marked increase does take 
place. 

Another experiment was conducted in 
which different groups received 0, 1, 5, or 
10 repetitions of the initial word associa- 
tion list before testing on another word 
association list and the unusual uses. A 
significant trend was evidenced on both 
originality tests, with a single repetition 
of the training list producing a significant 
increase in originality (Maltzman et al., 
1960). 

On the basis of the current dearth of 
relevant information, we can only specu- 
late as to why training with unusual uses 
failed to induce an increase in the uncom- 
monness of the responses. One hypothesis 
that may be offered is based upon the ap- 
parent relatively limited number of differ- 
ent uses available for each item. Given the 
instructions to write a different use to 
each repetition of an item and the in- 
ability of Ss to do so with a different oper- 
ant, they respond with essentially synony- 
mous uses repeatedly, a condition, as we 
have already seen, not likely to facilitate 
originality. 

If, as we have assumed, originality can 
be learned according to the principles of 
operant conditioning, then the effects of 
originality training should be of the same 
kind as those ordinarily obtained in ex- 
perimental studies of learning. One of the 
gross characteristics of learning is that the 
behavioral changes produced by reinforce- 
ment persist for some time, are not rela- 
tively transistory. Increased originality in- 
duced by the training method previously 
described should therefore also persist. An 
experiment designed to investigate this 
property of originality training has been 
conducted, and positive results have been 
obtained (Maltzman et al., 1960). Using 
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the standard control and experimental 
conditions of the previous experiments, a 
delay of approximately one hour was inter- 
posed between the training and test situa- 
tions for a control and an experimental 
group, and a delay of two days for another 
control and experimental group. A sig- 
nificant training effect was obtained on 
the word association and the Unusual 
Uses Test of originality. 

These results show that the effects of 
originality training persist to a significant 
degree for at least two days, under the 
given experimental conditions. We may 
conclude from these results and that of 
the previous experiment that the standard 
experimental procedure for training origi- 
nality produces some kind of learning. 


Relation of Originality Training 
to Learning to Learn 


Originality training studies of the kind 
reviewed here and learning to learn studies 
(Duncan, 1958; Harlow, 1949; Morrisett 
& Hovland, 1959) have the common char- 
acteristic of producing relatively non- 
specific transfer effects. Training on given 
stimuli transfers to other stimuli in the 
absence of any obvious opportunity for 
the operation of primary stimulus general- 
ization. Despite the apparent similarity 
between the results of training in learning 
to learn and those discussed here, differ- 
ences in the experimental operations and 
the kind of behavior induced in these 
procedures suggest that different princi- 
ples are involved in these situations. 

The learning to learn procedure in- 
volves the learning of a great many differ- 
ent discrimination problems. Different 
stimuli are presented repeatedly until S 
has learned a differential response to a 
criterion or has received a given number 
of trials. The responses are not varied and 
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uncommon responses are not reinforced, 
nor can they be, because a specified re- 
sponse is correct. Under these conditions 
Ss show a progressive decrease in the num- 
ber of trials required to learn new dis- 
crimination problems. In originality train- 
ing, on the other hand, variability of re- 
sponse is induced. Repeated presentation 
of the same stimuli and reinforcement of 
a specific predesignated response likewise 
does not occur in originality training. In 
learning to learn, the stimuli vary from 
problem to problem, but the responses do 
not. In originality training and test situa- 
tions the stimuli and the responses vary. 
Thus the two procedures differ in terms 
of the operations employed to induce non- 
specific transfer. Furthermore, the inter- 
pretations offered by Duncan (1958) in 
his comprehensive study of learning sets 
at the human level do not appear appli- 
cable to originality training. The acquisi- 
tion of observing responses, habits of 
looking at details of stimuli, etc. are im- 
portant in discrimination problems but 
do not appear to be particularly relevant 
in originality training situations of the 
kind described here. Likewise, the analy- 
sis of learning to learn by Morrisett and 
Hovland (1959) in terms of the discrimi- 
nation between stimulus trace patterns 
does not appear applicable to originality 
training. 


An Interpretaton of Originality Training 


Two basic problems, not unrelated, 
posed by the experiments on originality 
training by Maltzman and his associates 
(1958, 1960) demand an interpretation. 
First is the nature or source of the rein- 
forcement for originality. In all of the ex- 
periments, successive training trials in the 
standard experimental conditions are ac- 
companied by increases in the uncom- 
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monness of the responses. The originality 
induced in this manner transfers to differ- 
ent stimulus materials, and these effects 
tend to persist. Originality training thus 
produces behavioral changes that are 
characteristic of learning, yet they occur 
in the absence of differential reinforce- 
ment administered by E. Nevertheless, we 
believe that uncommon responses re- 
ceived differential reinforcement. Rein- 
forcement was obtained, because the oc- 
currence of any previously established 
intraverbal association is self-reinforcing. 
As Thorndike puts it: “The mere occur- 
rence of a connection strengthens it” 
(1949, p. 23). Thus, where there is an 
initial probability greater than zero that 
a given verbal stimulus will evoke a verbal 
response in an operant situation such as 
word association, the occurrence of that 
response will increase the probability of 
its occurrence on a subsequent presenta- 
tion of that stimulus. Different initial 
conditions may only increase or decrease 
the amount of reinforcement affecting 
the stimulus-response connection. In the 
type of experimental situation with which 
we are concerned here, the uncommon- 
ness of the response evoked by the stimu- 
lus is one of these conditions. In other 
words, the amount of reinforcement is 
inversely related to the initial probability 
of a verbal stimulus evoking a verbal re- 
sponse. Originality is more reinforcing 
than commonplace responding. 

An impression gained from observing 
Ss in the experimental situation is that 
repeated evocation of different responses 
to the same stimuli becomes quite frus- 
trating: Ss are disturbed by what quickly 
becomes a surprisingly difficult task. This 
disturbed behavior indicates that the pro- 
cedure may not be trivial and does ap- 
proximate a nonlaboratory situation in- 
volving originality or inventiveness, with 
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its frequent concomitant frustration. This 
impression of frustration accompanying 
the task of producing repeated uncom- 
mon responses would lend support to the 
notion that when such responses do occur 
they are self-reinforcing to a considerable 
degree. These speculations, however, are 
not essential to the investigation of the 
initial hypothesis of the self-reinforcing 
character of uncommon responses. How- 
ever, these as well as other considerations 
suggest that the distribution and schedul- 
ing of the evocation of uncommon re- 
sponses may be of great importance in 
determining the extent to which a transfer 
effect will be obtained. 

It should be noted, however, that the 
tole of self-reinforcement is probably less 
significant in producing an increase in 
originality during training, the successive 
repetitions of the same word list, than in 
the test situation. Since instructions to 
the standard experimental group prohibits 
the reoccurrence of the same response to 
a given stimulus word, successive re- 
sponses to that word will be progressively 
lower in the related response hierarchy. 
This is sufficient to account for the in- 
crease in the uncommonness of responses 
with successive repetitions of the same 
stimulus words. However, we believe that 
a second variable contributes to the in- 
crease in originality during the training 
session, generalization of the reinforce- 
ment effects from the evoked response to 
still more uncommon responses in the 
same hierarchy. However, the role of self- 
reinforcement becomes significant when 
the transfer of originality to the test situa- 
tions is considered. In this case the carry- 
ing out by S of previously administered 
instructions to give different responses 
will not account for the greater originality 
of the standard experimental condition in 
the test situations. 


This leads to the second problem pre- 
sented by the experimental data: the fact 
that the evocation of uncommon re- 
sponses on one list of stimulus words 
facilitates the occurrence of original re- 
sponses on a different list of words, and 
even more perplexing, on the rather dif- 
ferent Unusual Uses Test. The problem 
is to account for the fact that reinforce- 
ment of one instance of original behavior 
increases the response tendency for other 
instances of such behavior under different 
stimulus conditions. A relatively non- 
specific kind of transfer of training is in- 
duced. Without it, the facilitation of 
originality would not be possible. 

We do not have any simple rigorous 
explanation of this phenomenon at the 
present time, but offer the following 
tentative suggestions. The intraverbal as- 
sociations possessed by a normal educated 
adult are enormously extensive and com- 
plex. In all likelihood, almost every verbal 
response is associated to some extent with 
every other. Furthermore, the intraverbal 
associations among common verbal re- 
sponses are stronger than between com- 
mon and uncommon responses. Likewise, 
the intraverbal associations among un- 
common responses are relatively stronger 
than between uncommon and common. 
The evocation and reinforcement of un- 
common responses will, through complex 
kinds of mediated generalization, there- 
fore increase differentially the probability 
of occurrence of other uncommon re- 
sponses even though they do not ordi- 
narily occur to the same stimuli as the 
original reinforced responses. In a similar 
fashion, the evocation of common re- 
sponses would differentially increase the 
probability of occurrence of other com- 
mon responses even though they may be 
members of different response hierarchies. 
An additional characteristic of the stand- 
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ard experimental procedure used in origi- 
nality training is that it provides for the 
inhibition of common responses as well as 
the facilitation of uncommon responses. 
Through mediated generalization the ef- 
fects of inhibition will produce a decre- 
ment in the excitatory potential of other 
common responses. It is this characteristic 
which may be responsible for the more 
general transfer effects obtained with the 
standard experimental procedure than 
with the procedures that induce uncom- 
mon textual responses or employ uncom- 
mon stimulus situations for evoking, in 
turn, uncommon responses. None of these 
other procedures would involve the inhi- 
bition of common responses. 

It should be clear that the foregoing 
hypotheses are speculative and their con- 
nection with the data presented is tenu- 
ous. Considerable careful experimentation 
tracing the intraverbal associations present 
in the experimental situation is needed as 
well as the development of laws of verbal 
compounding before a completely ade- 
quate explanation of the basis for origi- 
nality training can be given. Whether or 
not such explanations can be given, the 
method of training originality described 
in this paper seems worthy of further 
study in its own right, and potentially 
may have considerable practical applica- 
tion. This again is a problem requiring 
sustained experimental research employ- 
ing different kinds of test materials. 

In conclusion, it should be emphasized 
that little is to be gained by disputing 
the usage of the term “originality” as it 
has been employed here, or whether the 
current experiments described are investi- 
gating the essence of originality. The im- 
portant problem is the experimental one 
of determining the variables influencing 
the occurrence of uncommon responses in 
relatively simple situations and the func- 
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tional relationships that obtain in these 
situations. Finally, the extent to which 
these effects hold for more complex be- 
havioral situations must be determined. 
Such work is now in progress in the 
UCLA laboratory. But to designate only 
highly complex behavior of a given sort 
as original to the exclusion of simpler 
better controlled behaviors seems gratui- 
tous, as well as an obstacle to the progress 
of research in this vital area. 


SUMMARY 


The basic problem in the training of 
originality is to devise a means of increas- 
ing the frequency of uncommon behavior. 
Once it takes place it may receive rein- 
forcement and increase the probability 
that other original behavior will occur. 
Earlier attempts to devise training meth- 


. ods for originality were briefly mentioned, 


as well as related studies of problem 
solving. 

A series of experiments by Maltzman 
and his associates was reviewed, and a 
procedure which consistently facilitated 
originality was described. This procedure 
involves the repeated presentation of a 
list of stimulus words in a modified free 
association situation accompanied by in- 
structions to give a different response to 
each stimulus. Under these conditions 
the responses become more uncommon. 
When presented with new stimulus ma- 
terials, Ss receiving such training are re- 
liably more original than Ss receiving no 
training. Tentative suggestions as to the 
behavioral bases for the training effect 
were given. 
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. . . We will state our basic hypothesis 
regarding the nature of creative thinking 
in the form of a definition, With these 
introspective statements serving as back- 
ground, we may proceed to define the 
creative thinking process as the forming 
of associative elements into new combi- 
nations which either meet specified re- 
quirements or are in some way useful. 
The more mutually remote the elements 
of the new combination, the more crea- 
tive the process or solution. An additional 
criterion of the level of creativeness of a 
product is described below. 

Creative thinking as defined here is dis- 
tinguished from original thinking by the 
imposition of requirements on originality. 
Thus, 7,363,474 is quite an original answer 
to the problem “How much is 12 + 12?” 
However, it is only when conditions are 
such that this answer is useful that we 
can also call it creative. There are many 
original ideas expressed in institutions for 
the mentally ill and mentally retarded; few 
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of these are likely to be creative. There 
are many fields of creative endeavor in 
which the usefulness of products would 
be difficult to measure reliably. While 
these difficulties must eventually be faced, 
for the present our research efforts have 
been concentrated on laboratory situa- 
tions in which criteria for usefulness can 
be arbitrarily experimenter-defined and 
unequivocally explained to the subject. 
The originality of a response is simply in- 
versely related to its probability in a given 
population. 

It should be pointed out that this defi- 
nition of creativity is quite similar to 
basic notions advanced by British associa- 
tionists from Locke (1690) to Bain 
(1855), and by those psychologists whose 
work is based in large measure on their 
speculations. Freud (1938), Hollings- 
worth (1928), and Binet (1899) may 
serve as examples, 


Ways of Achieving a Creative Solution 


In terms of associative theory, we may 
point to three ways of achieving a crea- 
tive solution. Generally, any condition or 
state of the organism which will tend to 
bring the requisite associative elements 
into ideational contiguity will increase 
the probability and speed of a creative 
solution. Therefore, the following three 
ways of attaining creative solutions are all 
methods of bringing the requisite associa- 
tive elements together. 


SERENDIPITY 


The requisite associative elements may 
be evoked contiguously by the contiguous 
environmental appearance (usually an ac- 
cidental contiguity) of stimuli which 
elicit these associative elements. This sort 
of creative solution is often dubbed seren- 


dipitous. This is the manner of discovery 
to which is popularly attributed such in- 
ventions as the X ray and such discoy- 
eries as penicillin. One physicist has de- 
scribed how he has reduced serendipity 
to a method by placing in a fishbowl large 
numbers of slips of paper, each inscribed 
with a physical fact. He regularly devotes 
some time to randomly drawing pairs of 
these facts from the fishbowl, looking for 
new and useful combinations. His pro- 
cedure represents the operational em- 
bodiment of this method of achieving 
creative solutions, 


SIMILARITY 


The requisite associative elements may 
be evoked in contiguity as a result of the 
similarity of the associative elements or 
the similarity of the stimuli eliciting these 
associative elements. This mode of crea- 
tive solution may be encountered in crea- 
tive writing which exploits homonymity, 
rhyme, and similarities in the structure 
and rhythm of words or similarities in the 
objects which they designate. The con- 
tiguous ideational occurrence of such 
items as alliterative and rhyming asso- 
ciates may be dependent on a factor such 
as primary stimulus generalization. It 
seems possible that this means of bring- 
ing about contiguity of associational ele- 
ments may be of considerable importance 
in those domains of creative effort which 
are less directly dependent on the manip- 
ulation of symbols. Here we might in- 
clude certain approaches to painting, 
sculpture, musical composition, and 


poetry. 


MEDIATION 


The requisite associative elements may 
be evoked in contiguity through the me- 
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diation of common elements. This means 
of bringing the associative elements into 
contiguity with each other is of great im- 
portance in those areas of endeavor where 
the use of symbols (verbal, mathematical, 
chemical, etc... .) is mandatory. For 
example, in psychology, the idea of relat- 
ing reactive inhibition and cortical satia- 
tion may have been mediated by the com- 
mon associates “tiredness” or “fatigue” 
(Köhler & Fishback, 1950). 


Individual Differences 


From the definition given above, the 
factors that will make for individual dif- 
ferences in the probability of achieving 
creative solutions may be deduced. Any 
ability or tendency which serves to bring 
otherwise mutually remote ideas into con- 
tiguity will facilitate a creative solution; 
any ability or tendency which serves to 
keep remote ideas from contiguous evo- 
cation will inhibit the creative solution. 

Listed below are several illustrative pre- 
dictions concerning individual differences 
that one may make from this theoretical 
orientation. 


NEED FOR ASSOCIATIVE ELEMENTS 


It should be clear that an individual 
without the requisite elements in his re- 
sponse repertoire will not be able to com- 
bine them so as to arrive at a creative so- 
lution. An architect who does not know 
of the existence of a new material can 
hardly be expected to use it creatively. 


ASSOCIATIVE HIERARCHY 


The organization of an individual’s as- 
sociations will influence the probability 
and speed of attainment of a creative so- 
lution. There is a whole family of predic- 
tions that one may draw from this con- 
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cept of the associative hierarchy. As an 
initial example, let us take the question 
of the manner in which the associative 
strength around ideas is distributed. If 
we present an individual with the word 
“table,” what sort of associative responses 
does he make? The individual who tends 
to be restricted to the stereotyped re- 
sponses, such as “chair,” may be charac- 
terized as having an associative hierarchy 
with a steep slope (see Figure 1). That is, 
when you get past the first one or two 
conventional responses to the stimulus, 
the individual’s associative strengths to 
other words or ideas (lower in the hier- 
archy) drops rapidly. We can also con- 
ceive of a second sort of individual whose 
associative hierarchy is characterized by a 
rather flat slope. This is an individual who 
perhaps also has as his strongest response 
the conventional chair. But for him this 
response is not overly dominant and so 
it is more likely that he will be able to get 
to the less probable, more remote kinds 
of associations to table. It is among these 
more remote responses that the requisite 
elements and mediating terms for a crea- 
tive solution will be lurking. This slope 
factor may be related to the mathematical 
analysis of associative production devel- 
oped by Bousfield, Sedgewick, and Cohen 
(1954). It probably is closely approxi- 
mated by their constant, m, measuring 
rate of depletion of the associative reser- 
voir. They found a high negative cor- 
relation between rate of association and 
total number of associations. It would be 
predicted from Figure 1 that the high 
creative subject (flat hierarchy) would 
respond relatively slowly and steadily and 
emit many responses while the low crea- 
tive subject (steep hierarchy) would re- 
spond at a higher rate but emit fewer 
responses. 
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High 


Associative response strength 


Low 


Chair Cloth Wood 


It would be predicted that the greater 
the concentration of associative strength 
in a small number of stereotyped associa- 
tive responses (steep hierarchy) the less 
probable it is that the individual will at- 
tain the creative solution. Thus, the word 
association behavior of the high creative 
individual should be characterized by less 
stereotypy and commonality. This last 
prediction is supported by a study by 
Mednick, Gough, and Woodworth 
(Mednick, 1958). Research. scientists 
rated for creativity were divided into rela- 
tively high (N = 15) and relatively low 
(N = 15) groups. The low creatives gave 
more stereotyped responses on 80% of a 
group of 36 test words from the Kent- 
Rosanoff list. (These test words were 
chosen for their tendency to elicit stereo- 
typed responses, Stereotypy was defined 
by the Minnesota Kent-Rosanoff Word 
Association Norms, Russell & Jenkins, 
1954). It should be pointed out that these 
results lend themselves to another pos- 
sible interpretation. The highly creative 
individual may also have a steep hier- 
archy but a deviant one. That is, his most 
dominant associative response may be 
quite strong but quite different from the 
popular, dominant associative response. 


Steep associative hierarchy 
Flat associative hierarchy 


Food 


Mobel 


FIG. 1. Associative hierarchies around the 
word “table.” From Mednick: Associative 
basis of the creative process. 


There are different predictions that can 
be made for the flat-associative-hierarchy 
creative and the steep-deviant associative- 
hierarchy creative. The latter is more 
likely to be the one-shot producer (a not 
uncommon phenomenon among novel- 
ists). If he does create further products, 
they will tend to resemble closely the first 
product. The former is more likely to be 
a multi-producer; he is more likely to pro- 
duce in a variety of avenues of creative 
expression. 

The prediction suggesting an expecta- 
tion of less creativity from an individual 
with a high concentration of associative 
strength in a few responses leads to an- 
other prediction. The greater the number 
of instances in which an individual has 
solved problems with given materials in 
a certain manner, the less is the likelihood 
of his attaining a creative solution using 
these materials. Such an individual will 
“know the meaning” of the elements of 
the subject matter. That is, he will have 
a steep associative hierarchy around these 
elements. An example of the operation of 
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this principle recently occurred to the 
writer while teaching an honors freshman 
introductory course in psychology at the 
University of Michigan. I was giving a 
well known interpretation of a well 
known experiment in stimulus general- 
ization when interrupted by a student 
who calmly stated that the interpretation 
was in error. After a few minutes of 
blustering I asked him to explain. His ex- 
planation proved him to be correct. I had 
been dealing with this material for years 
and “knew” the “correct” interpretation; 
for him this material was new, he had a 
low, flat associative hierarchy. Thus, if a 
newcomer to a field has the requisite in- 
formation, he is more likely to achieve a 
creative solution than a long-time worker 
in the field. This may be the reason that 
theoretical physicists and master chess 
players are often said to have passed their 
prime by the age of 25. 


NuMBER OF ASSOCIATIONS 


Ihe greater the number of associa- 
tions that an individual has to the requi- 
site elements. of a problem, the greater 
the probability of his reaching a creative 
solution, This variable is not independent 
of the preceding one since an individual 
with a high concentration of associative 
strength in few associative responses is not 
likely to have a proliferation of associa- 
tions. The more associates which are 
evoked by a requisite element of a prob- 
lem, the more likely it is that an asso- 
ciate will exist which will serve as a medi- 
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ating bridge to another requisite element, 
facilitating combination, It seems likely 
that this variable will not be related to 
speed of creative solution since it may 
take a good deal of time to get to the 
mediating links. . . . 
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QT 
Unaware of Where’s Awareness: Some Verbal 
Operants—Notates, Monents, and Notants* 


William S. Verplanck 


For some years now, problems of 
“learning without awareness” have arisen 
in a number of contexts; they have created 
a theoretical—and sometimes an experi- 
mental—fuss. Willy-nilly, those who in- 
vestigate human operant behavior sooner 
or later are among those involved, 
whether they have leaped, slipped, or 
been dragged into the fray. These seem 
to be the avenues by which participants 
enter into scientific controversies, as well 
as into barroom brawls. 

The courses of development of these 
two kinds of controversy are rather simi- 
lar. They show a certain orderliness. In 
both, as the dispute rises in heat, and the 
blows—or experiments—get exchanged at 
higher rates, the original issue tends to 
get lost, if there was one to begin with. 
In the present case, the issue summarizes 
itself in “You can’t,” “I can,” in progres- 


*From W. S. Verplanck, Unaware of 
where's awareness: Some verbal operants— 
notates, monents, and notants, in C. W. 
Eriksen (ed.), Behavior and awareness, 
Durham: Duke University Press, 1962. 
Reprinted by permission of the author and 
the Duke University Press. 


sively stronger inflections. Just what can 
or cannot be done either has been 
omitted, or repeatedly redefined, as the 
controversy has extended itself. It is not 
surprising that seemingly contradictory 
results turn up. To this writer, the pres- 
ent dispute, which seems to have some- 
thing to do with the subject’s ability to 
state experimental contingencies, is a re- 
grettable one. As it has developed it 
seems to have led to the performance of 
experiments on inappropriate forms of be- 
havior, and to a proliferation of specula- 
tive theory. 

By inappropriate forms of behavior, I 
mean this: the experiments that have 
been—by now—repeated over and over 
with only minor modifications are those 
that have confounded at least two ques- 
tions, the identification of response! 
classes and the stability (habituability) 
of reinforcers. “Saying plural nouns,” 
“constructing sentences in the first per- 
son,” “Mm-hmm,” and “Good” may 
serve to demonstrate the occurrence of 
operant conditioning, but they are not 
necessarily the best choices for experi- 


1For the usage of the terms response 
and stimulus, see stimulus (3) in the 
writer’s glossary (Verplanck, 1957). See 
also Stimulus III (Verplanck, 1954); and 
Gibson (1960). 
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ments on other problems. Statements 
about whether or not operant condition- 
ing occurs must depend upon the changes 
in behavior that occur with reinforcement 
and its withdrawal, and not upon any- 
thing the subject may have to say about 
it. (It should also be superfluous to point 
out that the terms “voluntary” and “oper- 
ant” refer, by and large, to the same be- 
haviors.) Many psychologists, in pursuing 
thought along these lines, seem to have 
tended to adopt ever more subtle (but 
not stringent) definitions of “awareness” 
and to have introduced theory in inverse 
proportion to the clarity of their experi- 
mental findings. Some seem to believe 
that if they can somehow demonstrate 
something that can be tagged with the 
label “awareness,” they have in some 
sense found an “explanation” for the or- 
derliness of human conditioning. 

One would not express discomfort with 
this state of affairs if it were not for the 
fact that this seems, at least to the writer, 
the wrong time to attempt to use “aware- 
ness” as explanatory, or descriptive, of 
much of anything. The fact is, very little 
is suggested as to how “awareness,” how- 
ever it may have been defined, can or 
does control or affect behavior in the first 
place. Statements about “awareness” as 
prerequisite to learning have shown little, 
if any, experimental unity, and the word 
seems to have become a label indicating 
an explanatory dead end. However the 
issues as they have thus far been stated 
were resolyed, little new information 
would be added. 

The word seems to be associated with 
a rather special kind of phenomenologi- 
cal approach to behavior. While this may 
seem somewhat heretical to those phe- 
nomenologically oriented, to the writer it 
has always seemed that when the experi- 
mental facts get established, their phe- 
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nomenological aspects seem to take care 
of themselves. 

Some years ago, E. J. Green (1955) re- 
marked that each of his subjects in a dis- 
crimination experiment could figure out 
its correct basis only once. The writer had 
made much the same observation during 
human conditioning (Verplanck, 1956). 
In the latter experiments, many subjects 
have a good deal to say while being con- 
ditioned; some of what they say is to the 
point. That is, some of it corresponds to 
the experimenter’s rules in conditioning 
the subject. Both these observations re- 
lated rather directly to subjects’ behavior 
in a number of exploratory experiments 
on discrimination and “concept-forma- 
tion” that the writer had been doing. In 
these, while seeming to behave in con- 
formity with continuity theory, the sub- 
jects always did a lot of “hypothesizing” 
(again, some of it to the point) a la the 
Tolman-Krechevsky school. Even the 
writer, resent it though he may (as a 
Spencian incrementalist at the time), 
found that he “hypothesized” when serv- 
ing as a subject. Self-observation, how- 
ever, yielded few clues as to what was 
going on. 

The common link seemed to be this: 
in all cases, the subject could come across 
the correct rule, the “solution,” only once 
in any experiment. Only once could 
Green’s subjects catch on to the critical 
dots that were correlated with reinforce- 
ment. Only once could the conditioning 
subjects “catch on” that “touching the 
nose with the right forefinger” produced 
a point. Only once could subjects figure 
out that pictures of “objects that can be 
used in transport” were to be put in the 
pile on the right. The correct rule, once 
said, hung on, the problem was solved 
(ten successive correct choices), and the 
experiment terminated. 
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The “aha” that came is this: in operant 
conditioning of rats and pigeons, too, the 
subject is observed to “solve the prob- 
lem” only once. Thereafter he “applies 
the solution.” In shaping bar-pressing or 
key-pressing, the skilled experimenter 
finds very quickly that he is dealing with 
a one+trial event. The first bar-press that 
yields the click of food dropping into the 
magazine, and then the rat’s quick dive 
toward it (a Guthrian affair), is followed 
in most cases by another bar-press, after 
an interresponse time that is no greater 
than those that are later recorded after 
10 or 100 reinforcements. Where this 
does not occur, it seems that the experi- 
menter, not the rat, made the mistake. 
We may look back at Estes’ paper on 
conditioning (Estes, 1950). To attain a 
clear-cut incremental process in bar-press- 
ing, he found it necessary to introduce a 
second bar; gradual changes in pressing 
bar 1 occurred while extinction to bar 2 
was going on. One might put it this way: 
incremental processes in conditioning 
seem always to involve extinction, either 
of the response itself to stimuli other 
than the one the experimenter has 
chosen, or of a competing response. With 
proper experimental control, operant con- 
ditioning is a “once” affair; subsequent 
reinforcements serve primarily to main- 
tain it at strength, and to develop resist- 
ance to extinction, which might be char- 
acterized as “reluctance to give up the 
solution.” At the time these considera- 
tions were asserting themselves, the writer 
was busy defining “response” for a glos- 
sary, and was struck both by the restric- 
tions that this empirical definition placed 
on the kind of behavioral events to which 
the term applied and by the extraordi- 
nary range of new behaviors which could 
experimentally prove to be responses, be- 
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having, under discriminative and reinforc- 
ing stimuli, in a simple manner. 

All this suggested an approach to some 
of the problems raised by human be- 
havior, and especially by verbal concepts. 
Let experimental work seek to establish 
directly how the verbal behavior occurring 
in an experiment is related to the other 
behaviors that occur. Verbal behaviors, if 
overt, meet the behaviorist’s demands for 
experimental data, and while they can 
hardly be expected to bear a one-to-one 
relationship with concepts of “aware- 
ness,” “hypotheses,” “mediators,” and 
the like used by others, there can be no 
dispute that they have something to do 
with at least part of what may be meant 
by “awareness.” So, we sought to make 
a direct experimental attack upon the 
problem of how verbal behavior acts un- 
der the effect of various environmental 
conditions, and how it in turn is related 
to the motor behaviors with which it is, 
at least linguistically, associated. Just how 
closely such verbal behaviors may relate 
to “awareness” must be left to those who 
are surer than I of what is referred to by 
the word. 

Specifically, we undertook to investi- 
gate the “rules”? that subjects say to 
themselves, and try out in various experi- 


2Since this paper was given, a mono- 
graph (Shepard, Hovland, & Jenkins, 
1961) has appeared in which the results 
of experiments on much more complex 
problems of the same class are reported. 
It is encouraging to note that data were 
gathered on the rules—the notants—that 
subjects eventually came up with, But no 
effort was made to determine experimen- 
tally their origin, and their history through 
differential reinforcement. It is the be- 
havior of such “rules” that this paper deals 
with. 
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mental problems. So long as these are 
allowed to remain covert, the experi- 
menter forfeits the opportunity to exert 
direct experimental control over them. If 
they are made overt, the experimenter 
can directly subject them to environmen- 
tal contingencies, as he can other be- 
haviors. The ways in which they are con- 
trolled by antecedent or consequent stim- 
uli can be determined by straightforward 
and simple experimental methods. We 
ild be able to determine how they 
w in response to environmental 
its, how they serve as discriminative 
iuli for other behaviors, and how they 
alter in strength with reinforcement. 

Our first guess was that overt verbal 
statements of “rules” would prove to be 
ple operant behaviors, conditionable 
as are other operants. Preliminary experi- 
mentation based on this proposition led 
to methods that have since been further 
developed. The first method is a simple 
one: it requires the subject in a “concept- 
formation” card-sorting experiment to 
state aloud, on each presentation of a 
stimulus-object, the “rule” that he is fol- 
lowing in trying to get as many cards as 
possible correctly placed to right or left. 
In this situation, where many different 
possible rules may apply, the experi- 
menter is able to make social reinforce- 
ment (“Right” or “Wrong”) contingent 
either upon the particular statement 
made by the subject, or upon the behav- 
ior that the statement instructed the sub- 
ject to perform. In either case, he may 
deliver it after the placement. 

Preliminary experiments determined 
the selection of the stimulus material and 
the problem. Stimulus materials which 
permit the experimenter to choose any 
one of an almost unlimited number of 
possible “solutions” proved indispensa- 
ble. The experimenter must be free to 
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change the “solution” of any problem in 
midstream—he must be able to make 
wrong what was previously right, and 
right what was wrong. He must have far 
more latitude than provided by, say, the 
Weigl cards. Second, the material must 
not require the acquisition of names (the 
acquisition of a single new response to an 
arbitrary class of events; stated conversely, 
the acquisition of a new stimulus class. 
See Shepard et al., 1962). Third, the be- 
havior required should not press the sub- 
ject’s immediate memory span. 


The Dissociability of “Rule” and Behavior 


The results of these experiments led us 
to choose as the first formal experiment 
one that seemed to place maximal de- 
mands on the proposition that subjects’ 
“hypotheses” are simple operants. We 
(that is, Stuart Oskamp [1956] and the 
writer) chose to show that these would 
occur at a high relative frequency even 
under partial reinforcement, under con- 
ditions where we could also keep track 
of the behavior presumed to be controlled 
by them. 

Stimulus materials consisted of a set of 
110 children’s “trading cards”*—backs of 


8The tremendous variety in trading 
cards, on which pictures and designs vary 
in innumerable dimensions, and which 
may be further varied, independent of 
their individuality, by presenting them to 
the subject upside down, sidewise, or the 
like, makes such procedures possible. There 
are an effectively infinite number of pos- 
sible rules that the experimenter can fol- 
low in giving reinforcement, and among 
which he can shift, whether he is reinfore- 
ing monents or placements. Similarly, their 
variety permits the experimenter to select 
stimulus materials with considerable free- 
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playing cards, each different from all the 
others. Single objects or figures were rep- 
resented on 55 of these, and 55 had two 
or more objects pictured. The subjects’ 
task was, given the cards one at a time, 
to place each either to the right or to the 
left. The instructions also told the sub- 
ject that he could get all of them cor- 
rectly placed. Three groups of college 
students were run. Members of all three 
groups, P, PH, and PH, received the in- 
structions to place each card to either 
right or left. Two of the groups, PH and 
PH, received the further instruction to 
state on each trial the rule followed in 
attempting to get the card right, before 
placing it. The first group, P, and one of 
the latter two groups, PH, were told 
“Right” or “Wrong” on each trial ac- 
cording to whether the card was placed 
correctly, The third group, PH, was told 
“Right” or “Wrong,” according to 
whether they had stated a specific ver- 
sion of the rule followed by the experi- 
menter in reinforcing, regardless of where 
they placed the card. (In group designa- 
tions, the italic indicates whether P 
[placement] or H [“hypothesis”] was re- 
inforced.) For all groups, reinforcement 
with “Right” or “Wrong” was given only 
after the card was placed. 

In order to assure that any experimental 
results obtained could not be accounted 
for in terms of partially correct hypoth- 
eses, only a limited subset of the rules 
that could produce consistently correct 
placements was positively reinforced in 
members of group PH. That is, we 


dom and control, although never with the 
degree of control provided by “artificial” 
materials, such as the Weigl cards. This 
flexibility seems indispensable for finding 
the orderly behavior of our subjects. 


shaped a particular set. The rules dif- 
ferentially reinforced for group PH were 
all of the form: “Single (one) principal 
object (figure, design) to the right, two 
(more than one, several, two, three) prin- 
cipal objects (figures, designs) to the 
left.” If the subject, in stating the rule, 
named the object or objects pictured, he 
was told “Wrong.” He had to use an 
abstract term. Records were kept, trial by 
trial, both of placements, and, for groups 
PH and PH, of rules stated. 

The procedure was this: acquisition’ 
trials were carried out as usual in this type 
of concept-formation experiment (contin- 
uous reinforcement of correct responses) 
until the subjects met the criterion of ten 
successive correct responses. Thereafter, 
with no change in instruction to the sub- 
ject nor any other indication of an altera- 
tion in procedure, all subjects were placed 
on a partial reinforcement schedule, in 
which they were told “Wrong” following 
each incorrect response, and following 
four out of each successive ten correct 
responses (placements for P and PH; 
rule statements for PH). On the remain- 
ing 60 per cent of correct responses, they 
were told “Right.” These positive rein- 
forcements were given according to a 
predetermined randomized schedule. 

This schedule places the correct rule- 
statement on partial positive reinforce- 
ment, and at the same time punishes in- 
correct rule-statement 100 per cent of the 
time. The strength of correct rule-state- 
ment will depend, then, on reinforcement 
by avoidance, on partial positive reinforce- 
ment, or on both. Any of these provides 
accrual of strength by conditioning proc- 
esses. 

Many statements that subjects in group 
PH could make would lead them to place 
the cards consistently in the correct pile 
(eg, “one dog, belongs to the right,” 
“two dancers go to the left”), but these 


UNAWARE OF WHERE’S AWARENESS; SOME VERBAL OPERANTS 


were not reinforced, since they did not 
correspond with the rule-statement re- 
quired by the experimenter. For members 
of group PH, if such “Wrong” state- 
ments were followed by placements con- 
sistent with them, they would be followed 
by reinforcement contingent on the cor- 
rect placement. 

The results of this experiment were 
clear. First, although the mean number 
of trials to criterion was smallest for group 
PH, such differences among groups were 
not reliable. Several subjects in this group 
first stated a correct rule following three 
or four consecutive correct placements. 
But our primary interest is in the behavior 
under partial reinforcement. Of the place- 
ments made by subjects in groups P and 
PH on reinforcement trials 51 through 
1004 following the ten trials in the cri- 
terion run, 60 per cent were reinforced, 
and for PH 58.9 per cent of correct place- 
ments followed instances of the correct 


4Through the first 50 trials, the per- 
centage correct drops from 100 per cent to 
an asymptotic value. The rate at which this 
occurs varies from subject to subject, evi- 
dently as a function of differences in the 
aversiveness of the socially presented 
“Wrong.” 
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tule that were reinforced. The percent- 
ages of correct placements under partial 
reinforcement were, respectively, 71.2, 
71.8, and 76.8, which differ significantly 
from chance (50 per cent), but not from 
one another. On the 23.2 per cent of the 
trials on which members of PH made in- 
correct placements, these subjects were 
reinforced 43.9 per cent of the time; that 
is, with 4 of every 10 incorrect place- 
ments, they stated the correct rule, the 
one for whose statement they were being 
reinforced. More striking are the percent- 
ages of trials on which (a) the correct 
rule, (b) rules that were incorrect, but 
yielded correct placements, (c) rules that 
related to the objects pictured, rather 
than to other features of the stimulus ma- 
terial (borders, colors, realism, and the 
like), were stated by members of PH 
and PH, the two groups giving the rules 
on each trial. These are summarized in 
Table 1. 

The data of the table indicate clearly 
that the rule that has been, and continues 
to be differentially reinforced, occurs at 
high relative frequency. Its relative fre- 
quency is higher than that of the be- 
havior it is presumed to control. Although 
PH subjects state the correct rule on 
92.2 per cent (and one or another version 
of it on 94.2 per cent) of the trials, they 


TABLE 1 
Percentages of Trials 51-100 on Which Members of Groups 
PH and PH Stated Each of Four Categories of Rules 


CATEGORY OF RULE STATED croup PH croup PH 
(1) Correct rule 30.2 92.2 
(2) Other version of rule that would yield 
correct placement consistently 18.2 2.0 
(3) Incorrect rules that named object depicted 17.2 y 
34.4 x 


(4) All others 


From Verplanck: Unaware of where's awareness: Some verbal operants— 


notates, monents, and notants. 
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place the cards correctly on only 76.8 per 
cent of the trials. In other words, they do 
not place the card where they say they are 
going to on 17.4 per cent of the trials. 
Group PH, however, states the correct 
tule, or a version of it, on 48.4 per cent of 
the trials, but places the cards correctly 
on 71.8 per cent—a discrepancy of 23.4 
per cent in the other direction. The rule- 
statement, and the behavior for which it 
is presumably a discriminative stimulus, 
have been dissociated by manipulating 
their contingencies of reinforcement. 

In a later experiment by Rilling (1962) 
on the reinforcing properties of “Right” 
and “Wrong,” one group underwent an 
experimental procedure which replicated 
that of group PH. He obtained results 
almost identical with those of Oskamp 
(1956): on 72.8 per cent of the trials, the 
placement was correct; on only 57.1 per 
cent of the trials was any version of the 
experimentally correct rule given. 

The results may be summarized as fol- 
lows: under partial reinforcement, the 
statement of a specific rule retains con- 
siderable strength, as do simple operants. 
The strength is, in fact, greater than that 
of the behavior that the rule is presumed 
to control—here, the placement of a card. 
Where reinforcement is contingent on 
placement, a higher percentage of cor- 
rect placements occurs than can be ac- 
counted for by correct rules. Experiment- 
ally, the subject’s rules, his “hypotheses,” 
can be dissociated to a degree from the 
behaviors that they are presumed to di- 
rect. He does not carry out his intentions. 


The Monent 


In fairness both to theorists, and to the 
conceptual system within which this ex- 
periment was done, it is now necessary 
to introduce a term for these “statements- 


of-a-rule” by our subjects. They must be 
distinguished from the “hypotheses” re- 
ferred to in many theories and from the 
tules followed by the experimenter in 
conducting the experiments, The term 
chosen is “monent,” derived from a Latin 
verb meaning “advising, guiding, or di- 
recting,” and it is “monents” that now 
become subject to a number of experi- 
ments aimed at determining further how 
subject’s verbal behavior acts in control- 
ling other of his behaviors. The outcome 
of this experiment leads, also, to further 
methods of investigating such verbal be- 
haviors, and hence to data that have 
shown their status as operants, their dis- 
criminative stimuli, and the kinds of 
events that reinforce them. For clarity of 
exposition, we will reserve the words 
“rule” and “principle,” for the rules fol- 
lowed by the experimenter. Let me sum- 
marize very briefly a variety of experi- 
ments, in the approximate order in which 
they were done, with a brief account of 
the immediate context in which they were 
performed, All of them are based upon 
the experimental method of shifting the 
basis of reinforcement from monent to 
monent, from monent to placement ac- 
cording to one or another rule, from 
placement to placement, and back again. 


A. EXTINCTION AND RECOVERY 


In order to determine how monents 
behave under extinction, we performed a 
number of experiments using the same 
stimulus materials, the same set of in- 
structions as those given to groups PH 
and PH, and the same general method.’ 


5 Many of these effects can be obscured 
by averaging the data of subjects. It is the 
individual subject whose behavior is or- 
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A simple demonstration comes when 
one gives the subject instructions to state 
the rule he is trying before each place- 
ment, and then tells him “Wrong” on 
every trial, Latencies of monents increase 
progressively, more and more improbable 
monents occur when they are finally 
given (“can be used to carry opium” is 
the writer's favorite), and finally the sub- 
ject gives up—“I can’t think of anything 
else”; “my mind’s a blank,” and so on. 
Only very rarely does a subject come up 
with the one paradoxically reinforceable 
monent: “Anything I say is going to be 


” 
rong! 
wrong! 


Extinction with spontaneous recovery 
occurs when the experimenter delivers re- 
inforcement according to the following 
rules: reinforce five consecutive times the 
second monent stated by the subject (i.e., 
the moment first stated by the subject on 
the second trial); extinguish this monent 
thereafter, but give five consecutive rein- 
forcements to the second new monent 
given after the last instance of the first re- 
inforced monent. Repeat this shift in re- 
inforcement two more times until each of 
four different monents has received five 
consecutive reinforcements, then shift to 
reinforcement of placement according to 
a tule that does not correspond with any 
of subject’s monents. Under these condi- 


derly. Combining the data of many sub- 
jects serves not only to force discontinuous 
data into a guise of continuity, but it also 
yields a degree of variability that leads one 
to seek “significance” by placing more and 
more subjects in each group, rendering it 
still less likely that one will either observe 
carefully the behavior of any one individual 
or sharpen up the experimental design. 
Subjects do differ from one another, and 
in ways that make group data treacherous. 
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tions, subjects will eventually reach the 
criterion of 100 per cent correct place- 
ment, but the monents they state typi- 
cally resemble closely the initially rein- 
forced four. These recur, to be re-extin- 
guished and again to recover spontane- 
ously. The subject often is never able to 
state the rule followed by the experi- 
menter in reinforcing placements, even 
though he reaches 100 per cent correct. 
Under these conditions, subjects may take 
several hundred trials to reach solution. 


B. Tae Monent As A CHAIN 
OF RESPONSES 


The protocols of this and of similar ex- 
periments show that the monent is a 
chain composed of two responses, made 
up of a word or phrase descriptive of the 
card, the “notate,” linked to an instruc- 
tion, the “predocent” such as “put to the 
right,” or “goes to the right.” A notate 
may not recur after a single unreinforced 
occurrence. If the subject says “people go 
to the right” and gets no reinforcement, 
he is not likely to try “people go to the 
left”; he is more likely to say something 
such as “cards with blue go to the right.” 
The two parts of the monent thus may 
be separated; their initial strengths differ 
greatly, as does their resistance to ex- 
tinction. 

A “notate” (Latin—roughly translat- 
able as “what has been observed”) is de- 
fined as follows: any word or phrase given 
in response to a stimulus or to an object 
incorporating stimuli. Notates can be 
further characterized as “descriptions,” 
“associations,” “discriminated responses,” 
“descriptive characteristics,” “categories,” 
or even “verbal percepts.” Notates are 
stimulus-controlled and are symbolic of 
one or another feature of the stimulus. 
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They are synonymous, then, with Skin- 
ner’s (1957) “tact.” 

The second part, “put to the right,” 
“goes to left” termed the “predocent” 
(roughly “instructing beforehand”), is 
defined as a verbal response that is an S? 
for motor behavior. (One might expect 
that there would be a third member of 
the chain, “is correct.” Such occur very 
rarely. ) 
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C. Some Response EQUIVALENCES, 
AND Lack OF THEM 


In some experiments, subjects have 
been permitted to say “same.” If, after a 
series of “sames,” the subject is asked 
what “same” means, he gives the monent 
last stated. That is, the subject’s “same” 
can be believed, and reinforcing “same” 
gives results identical, insofar as can be 
determined, with those obtained by re- 
inforcing the last previously stated mon- 
ent itself. Another effect should be 
noted: reinforcing “borders go to the 
left” is ordinarily equivalent to reinfore- 
ing “nonborders go to the right.” Under 
some circumstances in placement rein- 
forcement, which we would hesitate to 
try to characterize as yet, the two may be 
dissociated, and the subject may system- 
atically say, “borders to the left,” and 
“animals to the tight,” depending on the 
stimulus card presented. That is, monents 
may adventitiously become differentially 
reinforced with respect to stimuli. The 
effects of the adventitious reinforcement 
of “borders” when presented with cards 
having borders are not incompatible with 
those of the adventitious reinforcement 
of “animals” to cards with animals, and 
to cards with both borders and animals. 

Again under circumstances that have 
not yet been determined, subjects may 


show a perfect discrimination for place- 
ments to the right, and show no discrimi- 
nation of placements to the left, without 
respect to the strength of any monent. In 
these cases, some cards that belong on 
the right are being put to the left, and the 
SP for right placement has not yet be- 
come identical to that feature of the 
stimulus cards which the experimenter 
has chosen. For the subject, the SP? is a 
subclass of the stimulus the experimenter 
has chosen, 


D. Tue Discrimination Process: 
EXTINCTION OF PLACEMENTS TO Så 


Further analyses were made on the data 
obtained on individual subjects in groups 
P and PH of the initial experiment, and 
on subjects in other experiments follow- 
ing similar procedures. In these, cumula- 
tive frequencies of placements to the 
right are plotted as a function of cumula- 
tive instances of SP (i.e., the class of cards 
that belong on the right according to the 
experimenter’s rule) and of Sê for this 
response. A similar pair of curves is 
plotted for placements to the left. These 
curves show that incorrect card place- 
ments (the two S4R curves) fall off in 
extinction curves. Under PH instructions, 
the correct monent tends to occur for 
many subjects only after considerable ex- 
tinction has taken place. When this oc- 
curs, the extinction process is short-cir- 
cuited out, and the extinction curve takes 
a slope of zero at once. But considerable 
(and recoverable) resistance to extinction 
for either R in the presence of their $4’s 
remains, to reveal itself in “careless er- 
rors.” 

These results emphasize the fact that 
monents are not discriminated, but, once 
they occur correctly, may be reinforced 
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on every trial thereafter, whereas place- 
ments to the right or to the left can be 
reinforced only when their discriminative 
stimuli (cards that go to right and to left 
respectively) are presented, Placements 
seem governed by Spencian laws, based 
on differential reinforcement with respect 
to two sets of stimuli, that is, with rein- 
forcement of correct and nonreinforce- 
ment of incorrect responses with respect 
to their stimuli. The correct monent, by 
contrast, as in simple operant condition- 
ing, is reinforced on every trial, irrespec- 
tive of the particular stimulus presented, 
and single reinforcements yield immedi- 
ate repetitions. Both continuity and non- 
continuity theories are substantially cor- 
rect—but for different behaviors. How- 
ever, unless reinforcement of monents is 
experimentally distinguished from that of 
placements, the correct monent will “take 
over” as soon at it occurs, and will ob- 
scure the gradual development of a dis- 
crimination. 


E. DIFFERENTIAL REINFORCEMENT 
or MONENTS 


It should be possible to place monents 
under discriminative control by making 
reinforcement of a particular monent con- 
tingent upon the presence of a particu- 
lar discriminative stimulus. Thus, under 
S? (as experimenter leaning forward or 
the card presented sidewise) “people to 
the right, nonpeople to the left” can be 
reinforced, and under S4 (experimenter 
sitting up straight or the card presented 
straight up and down) “cards with bor- 
ders go to the right, nonborders to the 
left.” (This is evidently the “conditional 
hypothesis.”) Experiments of this sort 
were done, and, the expected discrimina- 
tion curves for the monents were found. 
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F. MANIPULABILITY OF AVAILABILITY 
OF MONENTS 


When subjects are used in a series of 
experiments, with the reinforced monent 
varied from time to time, there are large 
transfer effects. An initially improbable 
monent may appear first in a new experi- 
ment, if it has been reinforced in an 
earlier one. Subject’s repertory of mo- 
nents, and their relative probabilities, may 
be manipulated over a wide range (“sali- 
ence”). 


G. Covert Monents 


It should be emphasized that no as- 
sertion has been made that the spoken 
monent is the only verbal behavior in- 
volved, Subjects show many signs of 
covert verbal behavior, and much of this 
becomes overt when the experimenter 
asks questions. The subjects’ answers 
often yield additional notates and mo- 
nents different from what was given 
aloud, or give elaborated versions of the 
overt one: “I was wondering if it had 
something to do with alternate piles, 
too,” or “It may be a particular kind of 
people.” These previously unstated mo- 
nents (where the subject is not follow- 
ing the experimenters instruction to 
him) may pick up a few reinforcements 
adyentitiously. 

The final experiments of this series 
deal with covert monents directly. 


H. Conprtioninc or Covert Monents, 
AS SUPERSTITIONS 


An experiment was designed to de- 
termine whether a covert event that cor- 
responds in its behavior with the monent 
occurs. Subjects, run together in sets of 
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five before an audience, have been given 
the following instructions: “You will be 
shown a series of pictures. Following a 
simple rule, some of them are plusses, 
and some minuses. Your job is to find the 
tule that makes each card a plus or a 
minus. On each trial, write in your data 
book whether you think the picture is a 
plus or a minus, and you will be told 
whether you are right or wrong each 
time. When you think you know what 
the rule is, put a check next to your 
answer on that trial. When you are cer- 
tain what the rule is, put a double check.” 
The subjects were then individually rein- 
forced according to an arbitrary prear- 
ranged schedule, independent of their 
overt response, although the individuals 
delivering the reinforcements went 
through the motions of looking at them, 
before saying “Right” or “Wrong.” 

On trials 1, 3, 4, and 7, all subjects 
were told “Wrong.” On all other trials 
through trial 30, all subjects were told 
“Right.” Over the next 12 trials (31-42), 
one of each set of five subjects was told 
“Wrong” once, another 3 times, another 
6 times, another 9 times. On the other 
trials, all were told “Right.” In each set, 
one control subject remained on continu- 
ous reinforcement, that is, he was told 
“Right” on every trial past 7. All sub- 
jects were then continuously reinforced 
for a further 28 trials (to a total of 70). 
At the end, the subjects were asked to 
write down the rule that was correct, and 
how sure they were of it, and, if the rule 
changed, to write down the second rule, 
and how sure they were of it. This pro- 
cedure has been replicated a number of 
times. 

In this procedure, then, reinforcements 
occur—are “shot in”—at times when a 
monent should have occurred covertly, 
but the reinforcement was independent 


of what the monent might be. Monents 
could be conditioned, then, as “supersti- 
tions.” The results indicated that covert 
monents occur, and that they behave un- 
der reinforcement as do overt ones. 

1. Every subject reported at least one 
tule of which he was “certain” or “very 
sure.” The relative frequencies of the 
monents that were conditioned corre- 
spond with those observed of overt mo- 
nents before differential reinforcement 
(animals, people, borders, realistic, up- 
side down, single vs. plural, and the like). 

2. For the 18 subjects who followed 
the instruction to check and double 
check, a median of four consecutive rein- 
forcements (range 1-14) preceded the 
trial on which they reported that they 
“thought they knew what the rule 
and a median of five more reinforce 
(range 3-22) made them “certain” or 
“very sure.” Of those subjected to partial 
reinforcement through trials 31-42 an in- 
sufficient number of subjects made 
checks, so that no results can be reported. 

3. A single nonreinforcement seldom 
extinguishes or alters the correct monent 
after it has been on continuous reinforce- 
ment for some time. In general, the 
greater the number of nonreinforcements, 
the more different the second covert mo- 
nent from the first. (Table 2) 

4. At the end of the series of 70 cards, 
every one of the 25 subjects reported be- 
ing certain of the first rule. Every subject 
who reported a change in the rule, was 
either “sure” or “pretty sure” of the sec- 
ond rule as well. 

We may state with confidence that mo- 
nents occur covertly, and that they are 
then subject to the same laws of rein- 
forcement as when they are overt. 

In all these experiments, the behavior 
of individual subjects was orderly to a 
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TABLE 2 


Number of Changes in Monents Reported as a Function of Number of 
Nonreinforcements through Trials 31-42 (N = 25) 


GROUP A B Cc D E 
No. “Wrongs” 0 1 3 6 9 
trials 31-42 
Kind of change 
None 5 2 1 Ja 0 
Minor change» 0 3 3 2 2 
Complete change* 0 0 1 2 3 


CEU eS — 

a The subject wrote: “red in background, +. Changed in mid- 
dle (of series), and went back to original.” 

b Minor changes include (a) simple reversals, additions (origi- 
nal: “persons = +; then persons with horses = +”), contrac- 
tions (original: living things +, then animals and flowers +), 
expansions (original: “animals negative” to “live negative”). 

€ Complete changes: no relationship between first monent and 
second, e.g., “borders +, to animals +,” and “animals and hu- 
mans +,” to “photos.” 

From Verplanck: Unaware of where’s awareness: Some verbal 


operants—notates, monents, and notants. 


high degree; subject’s “thinking” came 
under experimenter’s control in very 
much the way the behavior of a rat does 
when a response is being shaped. On the 
other hand, questioning a subject at the 
end of these experiments on what he was 
doing, or what he thought was going on, 
or how he solved the problem, yields a 
good deal of verbal behavior that usually 
corresponds poorly with what the subject 
had in fact been doing, or how frequently 
he had been reinforced. It reflects very 
seldom the environmental variables whose 
control led this subject to behave as other 
subjects do under the same procedure. 
What the subject answers to such ques- 
tions seems to be most closely related to 
his behavior over the few trials immedi- 
ately prior to the questioning, and sug- 
gests a short-range “immediate memory.” 
Rationalizing, not reasoning, seems to be 


the appropriate term. The statements re- 
call the flavor of the introspective proto- 
cols given by subjects in the functional- 
ists’ experiments at the beginning of the 
century. One can hear and see what led 
Watson to behaviorism. 
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chapter y I 


Attitude Learning 
and Human Motivation 


LEARNING APPROACHES to the study of “attitudes” have sprung for the most 
part from Hull’s early formulations, especially from the concept of the pure 
Stimulus act already described. The first article to be presented in this 
chapter is a classic by Doob and represents the beginning of theoretical and 
experimental analyses of attitudes within the learning framework. Doob 
considers attitudes to be, primarily, implicit conditioned responses which 
ani mediate other overt responses with respect to the stimulus object which 
elicits the attitudinal response. The important contribution made by 
analyzing a field in learning terms is shown by the fact that each of the 
experimental studies in this section, and some in the next, is influenced 
heavily by Doob’s analysis. 

The study by Lott represents an experimental test of Doob’s formula- 
tion which utilizes the paradigm of mediated generalization. Although the 
design is quite complicated, the results show that “choosing” objects (atti- 
tudinal preference) by color can be affected by conditioning of a rein- 
forcing nature which has occurred to the name of the color—but not to 
either the object or the color itself. The attitudinal response in this case 
would have been established solely to the verbal response. 

The study by Scott takes Doob’s formulation concerning attitude learn- 
ing and extends it by developing a lifelike procedure in which the attitude 
response toward an issue is altered by reinforcing verbal behavior (debat- 
ing) about the issue. Positive reinforcement for verbal behavior with 
respect to an issue, as would be expected on the basis of the previous 
analyses, results in the verbal behavior (issue) becoming positively rein- 
forcing, that is, eliciting a positive attitude. 

The present author's method for demonstrating that the evaluative 
meaning response to words can be respondently conditioned was described 
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in Selection 21. It was also indicated that attitude formation can be con- 
sidered to involve these principles and that the operation of language is 
heavily involved in the formation and change of attitudes. The next study 
extends this suggestion and helps integrate the concept of word meaning 
and attitudes within the framework of respondent conditioning principles. 
In this study the stimulus word (national name) is again given attitudinal 
value or positive evaluative meaning (or in operant conditioning terms, 
conditioned reinforcing value) through pairing the word with other posi- 
tive meaning words. The national name is never paired with a primary 
reinforcer. All conditioning is done on a language basis, again supporting 
the significant implication that one of the important functions of language 
is the ability to produce verbal and nonverbal stimuli that have attitudinal 
(or reinforcing) properties. 

Thus, to summarize, it has been proposed that neutral stimuli that are 
paired with conditioned or unconditioned stimuli that have reinforcing 
value will themselves become conditioned reinforcing stimuli (CS"). The 
response the CS" elicits (which accounts for its reinforcing properties) may 
be called an attitude, or attitude response, when the stimulus has some 
social significance. On the other hand, when the stimulus is a word, the 
response to the stimulus is apt to be called the word’s meaning. (As will 
be discussed in the next section, when the stimulus object is a person in a 
group, the term group cohesiveness is invoked to describe differences in 
reinforcing value of the stimulus object.) Thus, each of these important 
fields of study may be seen to involve the principles of respondent condi- 
tioning as these principles account for the development of this important 
characteristic of the stimuli. 

However, the study of attitudes involves not only the principle under- 
lying the development of the attitudes, but also the manner in which 
attitudinal stimuli function. In its broadest sense, the study of attitudes— 
and other reinforcing stimuli commonly described as values in social psy- 
chology and sociology, needs and interests in personality theory, and 
fetishes and urges in abnormal psychology, to mention a few examples— 
is the study of human motivation. To fully appreciate the importance of 
the development of these reinforcing stimuli, as well as to integrate the 
account with previous discussions, a word must be said of the importance 
of these stimuli in “shaping” human behavior. 

First, a great deal of information is given about the behavior of an 
individual (or, as we shall see, a group of individuals) when the nature of 
the reinforcers that are effective for the individual are described, as well 
as the rules by which these reinforcers are applied. For these two types of 
knowledge will tell us much about the types of behavior that the individ- 
ual will develop. 

For example, in our society some of the stimuli that have a good deal 
of reinforcing value are social and personal attention, acclaim, and respect; 
money, fine clothes, expensive cars, and houses; and various tokens such 
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as awards and honors. In our society, also, there are “rules” (not formal or 
explicit) for the application of these stimuli. That is, they are delivered 
contingent upon some kinds of behavior but not upon others. Thus, large 
amounts of these stimuli are delivered contingent upon exceptionally 
skilled baseball, football, acting, dancing, or comic behaviors, among 
others. Relatively small amounts are delivered contingent upon the be- 
haviors of skilled manual work, teaching, unskilled manual work, nursing, 
and many others. 

These characteristics of our reinforcing system and its rules of applica- 
tion, to continue with the example, have an effect upon the manner in 
which behavior in our society is shaped. Consider, thus, a boy who has 
two classes of skilled behaviors, one a set of intellectual skills consisting of 
knowledge and well-developed study and scholarly work habits, and the 
other consisting of some form of fine athletic prowess. Let us say that 
either behavior could be developed to “championship” caliber. Now, in a 
situation in which the larger amount of reinforcement is made contingent 
upon the one behavior, this behavior will be strengthened, and as must be 
the case, at the expense of the other to the extent that the behaviors are 
incompatible. In our society, of course, many of the strongest reinforcers 
are more apt to be more liberally applied to athletic rather than scholarly 
behavior. 

When groups are considered, it would also be expected that the rein- 
forcer system and its rules of application will determine the types of 
behaviors that are dominant. A society that has a differing set of reinforcers 
and rules will evidence different behavior over the group of people exposed 
to that set of conditions. A society, for example, whose reinforcers are 
made contingent upon scholarly research behaviors to a larger extent than 
another society will create stronger behaviors of that type, in a greater 
number of people, than will the other society. In general, all of the differ- 
ent cultural, national, and class behaviors that have been observed in 
sociology, anthropology, and other behavioral sciences, can be considered 
to involve this aspect of human motivation—the reinforcer system and its 
rules of application. 

The reinforcer system, including the many social attitudes, must also be 
considered of great importance in understanding abnormal behavior. An 
individual who has a markedly different reinforcer system than those in his 
group is likely to develop abnormal behavior. Thus, the male for whom 
other males are strong sexual reinforcers is more likely to develop homo- 
sexual behaviors, for such behaviors will be strengthened by contact with 
those reinforcers. The problem of behavioral treatment may thus involve 
changing the nature of the individual's reinforcer system. 

These, of course, are simplified examples and take no account of other 
variables that will also contribute to the eventual outcome. However, in 
principle, it can be suggested that the nature of the individual’s or group’s 
reinforcer system and the rules of response-contingent application are 
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crucial determinants of individual and group behavior. Thus, a descrip- 
tion of those events, and an understanding of the principles by which 
reinforcers affect behavior would be expected to yield a great deal of 
knowledge of individual and group behavior. While the above examples, 
as well as those to follow, involve positive reinforcing stimuli, it should 
be remembered that the implications hold also for aversive stimuli in the 
individual’s reinforcing system. These stimuli, of course, strengthen be- 
havior that is followed by the removal of the negative reinforcing stimulus. 

It should also be indicated here that deprivation and satiation operations 
would be expected to play an important role in human motivation. It has 
been shown many times in laboratory study with lower organisms that 
deprivation of a primary reinforcer increases the reinforcing value of a 
stimulus. And the results of Gewirtz and Baer in Selection 7 also suggest 
that the same is true of conditioned reinforcers, with human subjects. 

It should be added, based upon this principle, that deprivation and 
satiation should be capable of affecting the relative strengths of reinforcers 
in an individual’s system. Thus, deprivation of sex reinforcers would be 
expected to increase the reinforcing value of this class of stimuli, at the 
expense of other reinforcers in the individual’s system. For the adolescent, 
under this type of deprivation, other reinforcers may be relatively weak 
and the behavior maintained by those reinforcers—study, reading, family 
activities—may weaken. 

Deprivation may also affect the reinforcer system, and thus behavior, in 
a somewhat different way. When a prisoner is deprived of contact with 
the opposite sex, the general class of sex reinforcers will increase in relative 
strength. As a consequence, reinforcers that are more accessible, for ex- 
ample, homosexual contact, will be relatively stronger and may shape be- 
haviors that would be unlikely to occur without the deprivation. 

It should be emphasized that in this way each instance of homosexual 
sex reinforcement would be expected to increase the reinforcement value 
of members of the same sex through learning, thus further altering the 
structure of the reinforcement system on a more permanent basis. That is, 
the members of the same sex could become stronger reinforcers than mem- 
bers of the opposite sex—a circumstance that will tend to persevere once 
it occurs because learning is permanent until extinction, punishment, or 
counter-conditioning take place. 

Thus, deprivation can affect the reinforcer system in two ways, which 
can be exemplified by considering two conflicting old saws. “Absence 
makes the heart grow fonder” may be seen as a description of the effects 
of deprivation on a person’s reinforcement value. On the other hand, “Out 
of sight, out of mind” might be expected when new people are contacted, 
as a result of deprivation, under reinforcing circumstances, making the new 
people stronger conditioned reinforcers. The first saw describes deprivation 
and its motivational effects on the relative and absolute strength of a rein- 
forcer in the reinforcer system. The second describes the fact that when a 
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person is deprived of one reinforcer he is likely to have experiences that 
will establish new reinforcers. 

Perhaps this indicates to some extent the significant role attitudinal (and 
other reinforcing) stimuli play in shaping human behavior, and the 
importance of the principles involved. However, the account of the rein- 
forcing function of stimuli does not complete an account of human moti- 
vation, For further details of the author’s formulation see Staats and 
Staats, 1963. As some of the articles in the next chapter will also show, 
establishing attitudinal (reinforcing) stimuli in the group will affect the 
behavior of members of the group in an additional way. 

One further point: this analysis and the articles that are to be presented 
in this chapter indicate some of the additional possibilities for the inte- 
gration of learning principles. That is, a stimulus that would be spoken of 
as eliciting an implicit attitudinal response can be seen to function as a 
reinforcer. The manner in which the two approaches lend themselves to 
a more complete account of human behavior may also be seen in some 
of the other papers that follow. 


28. 
The Behavior of Attitudes* 


Leonard W. Doob 


There is no question that the subject 
of attitude and attitude measurements is 
important in sociology and social psy- 
chology. Social scientists continue to dis- 
cuss the nature of attitudes in articles like 
this, to conduct experiments which show 
that behavior is affected by attitude, and 
to measure attitudes for theoretical or 
practical purposes. The problem of what 


*From L. W. Doob, The behavior of 
attitudes, Psychol. Rev., 54, 135-156 
(1947). Reprinted by permission of the 
author and the American Psychological 
Association. 


an attitude is and how it functions, never- 
theless, persists and—as many writers on 
attitudes likewise point out in their intro- 
ductory paragraph—little explicit agree- 
ment is apparent in the published litera- 
ture. 

The purpose of this paper is not to 
criticize other definitions or usages of the 
term but systematically, if partially, to 
relate the concept of attitude to what is 
known as behavior theory (17).1 Almost 


1 The writer is deeply grateful especially 
to Neal E. Miller as well as to Irvin L. 
Child, John Dollard, and Mark A. May 
for their constructive criticisms. He has 
promiscuously and deliberately borrowed 
some of their ideas and, as an insignificant 
token of his gratitude, herewith absolves 
them of any responsibility for the final 
product. 
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all writers, no matter what their bias, 
agree that attitudes are learned. If this is 
so, then the learning, retention, and de- 
cline of an attitude are no different from 
the learning of a skill, a piece of prose, or 
a set of nonsense syllables; and they must 
also involve the problems of perception 
and motivation. 

Immediately it is necessary to raise and 
answer the question as to why a simple, 
commonsense, ubiquitous concept like at- 
titude should be translated into semi- 
technical jargon. There are at least two 
answers to the question. The first and less 
important answer involves scientific 
methodology: it is thought desirable to 
bring as many terms as possible relating 
to a field of research (in this instance, 
human behavior) within one universe of 
discourse. Misunderstandings result from 
using one set of concepts to describe per- 
ception, learning, and motivation on one 
level and another set on a different level. 
Even if some sociologists who use the 
concept “attitude” are not attracted by 
the terminology of behavior theory and if 
they remain inclined merely to assume 
perception, learning, and motivation 
without inquiring into the details of the 
processes, unified knowledge concerning 
human behavior requires that there be a 
connection between what the sociologist 
studies or measures and what the psy- 
chologist studies or measures. Secondly 
and of crucial importance, a tentative 
translation of a term from one level to 
another and into an already and perhaps 
better developed theoretical system is 
fully justified if thereby inadequacies on 
the higher level can be pointed out. Mur- 
ray and Morgan (27), for example, have 
recently shed new light on the nature of 
attitude by incorporating the closely re- 
lated concept of sentiment into the for- 


mer’s previous conceptualization of per- 
sonality. 

The procedure to be followed in this 
paper is as follows: 

1. A definition of attitude in behav- 
ioral terms will be given. It is felt that 
such a definition represents an advance 
beyond the stage of defining an attitude 
as the subjective counterpart of some- 
thing in the environment, as a predisposi- 
tion within the organism, or as being 
what the attitude scale measures. The 
psychological implications of the defini- 
tion will be made clear. 

2. The consequences of this definition 
and the theoretical structure it assumes 
will then be summarized briefly by call- 
ing attention’to the factors which should 
be kaoni make a completely adequate 
analysis of attitudes. 

3. Illustrative research employing the 
concept of attitude will be critically ex- 
amined in terms of these factors. Such a 
detailed examination seems preferable to 
surveying the attitude literature in gen- 
eral terms. 


Definition of Attitude 


Attitude is defined as an implicit, drive- 
producing response considered socially 
significant in the individual's society. This 
definition states, in effect, that from the 
psychological point of view attitude is an 
implicit response with drive strength 
which occurs within the individual as a 
reaction to stimulus patterns and which 
affects subsequent overt responses. Since 
psychologists and other social scientists 
sometimes disagree concerning the nature 
and attributes of an implicit response of 
this type, the definition is therefore elabo- 
rated and broken down typographically 
into the phrases and clauses requiring fur- 


ther definition, elaboration, and discus- 
sion: 

“An attitude is: 

(1) “an implicit response 

(2) “which is both (a) anticipatory 
and (b) mediating in reference to patterns 
of overt responses, 

(3) “which is evoked (a) by a variety 
of stimulus patterns (b) as a result of 
previous learning or of gradients of gen- 
eralization and discrimination, 

(4) “which is itself cue- and drive-pro- 
ducing, 

(5) “and which is considered socially 
significant in the individual’s society.” 

l. “An attitude is an implicit response. 
.. .” By an implicit response is: meant a 
response occurring within the individual 
and not immediately observable to an out- 
sider. Motor ‘attitudes’ like the physical 
set of the runner before the starter’s gun 
is fired, therefore, are not included within 
the universe of discourse being analyzed 
because they are not entirely implicit and 
hence are instrumental rather than medi- 
ating acts. The semantic connection of 
such sets with the concept of attitude 
employed by social scientists is considered 
to be largely fortuitous from an historical 
standpoint. 

Overt behavior that is observable to an 
outsider may be affected by the evoked 
attitude but is not here defined as the 
attitude itself. Attitude refers to the indi- 
vidual’s immediate but implicit response 
to a stimulus pattern and his consequent 
tendency to respond still further as a re- 
sult of that implicit response. Such an 
implicit response may be conscious or un- 
conscious, distinctly verbal or vaguely pro- 
prioceptive. What is expressed results not 
from the attitude alone but represents, as 
will be indicated, another response in a 
behavior sequence—an overt one—which 
is a function of the attitude-response and 
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other tendencies within the individual. 

2(a). “An attitude is an implicit re- 
sponse which is . . . anticipatory . . . in 
reference to patterns of overt responses. 
...” An anticipatory response—called 
also an antedating response by Hull (17, 
p. 74)—is one which originally preceded 
another rewarded response and which, as 
a result of being associated with or pro- 
ducing this reward, has been reinforced so 
that it occurs before its “original time in 
the response series” (25, p. 49). If an indi- 
vidual, for example, dislikes a fruit or a 
person, he tends to avoid eating the fruit 
or meeting the person. Originally the 
avoidance occurred only after actual con- 
tact had been established and after that 
contact had proven to be punishing and 
the withdrawal to be rewarding. When a 
thorough investigation reveals no actual 
prior contact, some process of generaliza- 
tion or discrimination must have occurred 
since all behavior has antecedents. ‘The 
possibility of exceptions under different 
psychological conditions must be noted, 
even in these trivial illustrations: the fruit 
may be eaten anyhow if the individual is 
very hungry and the person may be met 
and greeted if social circumstances so re- 
quire. 

The conditions under which a response 
moves up in the behavior sequence and 
becomes anticipatory have so far been de- 
termined concretely in relatively simple 
situations. It has been shown (25, p. 79), 
for example, that the closer the response 
is in the series leading to the reward, the 
more likely it is to be leamed and then 
subsequently to antedate other responses 
not leading to the reward. This principle 
suggests why few objects or individuals in 
society fail to arouse attitudes. Originally 
the individual has had to react to them or 
has been taught to react to them in the 
course of being socialized. One of the re- 
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sponses leading to the goal response 
(which by definition involves reward or 
the avoidance of punishment) has im- 
plicit components, is reinforced, and is 
here called an attitude. 

2(b). “An attitude is an implicit re- 
sponse which is . . . mediating in refer- 
ence to patterns of overt responses. . . .” 
Whereas the anticipatory character of at- 
titude indicates its temporal relation to a 
goal, its mediating attribute calls atten- 
tion to its functional connection with that 
goal. A mediating response is made in an 
attempt to increase the likelihood of the 
occurrence of reward rather than punish- 
ment in connection with a goal response. 
In reasoning, for example, implicit re- 
sponses intervene between the original 
stimulus pattern and the goal response 
and may assist the individual in achieving 
that goal. Attitudes can be evoked so 
easily because as mediating responses in- 
volving only language, imagery, or pro- 
prioceptive reactions they need not con- 
flict with the overt behavior of the in- 
dividual or with his environment. 

The mediating function of attitude has 
led May to suggest that attitude is “a kind 
of substitute goal response” which “arises 
when the goal response cannot be immedi- 
ately and easily made” (24). This attrib- 
ute, which has also been suggested by 
other writers (e.g., 3, pp. 425-6 and 28, 
pp. 28-9), does seem to characterize cer- 
tain attitudes. The individual who dislikes 
another person is restrained or restrains 
himself from hurting his antagonist; in- 
stead he makes an implicit response in- 
volving aggression and feelings of avoid- 
ance or repulsion. It is felt, however, that 
all attitudes cannot be so characterized. 
The liked object, for example, evokes an 
implicit response which facilitates rather 
than acts as a substitute for overt behavior 
in reference to it. Overt behavior, in short, 


may be mediated by attitudes almost im- 
mediately and there need not necessarily 
be a conflict or a restraint before the atti- 
tude is evoked. 

Three consequences arise immediately 
from this conceptualization of attitude. In 
the first place, it appears psychologically 
futile—as Sherif and Cantril have indi- 
cated (33, pp. 304-5)—to attempt to clas- 
sify attitudes. Responses can be character- 
ized in so many different ways that a sim- 
ple dichotomy or trichotomy usually must 
be willfully stretched if it is to include all 
types of behavior. The response defined 
as attitude might be called positive or 
negative or be said to involve approach or 
withdrawal were it not for the fact that 
these terms then require further defini- 
tion which cannot be consistently or use- 
fully applied to all situations. Both ap- 
proach and avoidance, for example, may 
be but are not necessarily involved in 
what has been called a neutral attitude or 
in any attitude for that matter. It seems 
better, in short, to apply socially useful 
labels to attitude as the need arises, in 
order to indicate the direction in which 
the individual thereby is oriented; but it 
should be clearly recognized that the 
labels have social and not psychological 
significance. A psychologically important 
distinction, however, is that between gen- 
eral and specific attitudes (5), a distinc- 
tion which refers to the stimulus patterns 
evoking the response or to the evoked 
responses. 

In the second place, reference is made 
in the definition to “patterns of overt re- 
sponses.” For reasons hereafter suggested, 
overt behavior can seldom be predicted 
from knowledge of attitude alone. Under 
varying conditions within the individual, 
a given attitude can mediate a repertoire 
of overt responses. A favorable attitude 
toward a social institution, for example, 


can mediate innumerable responses con- 
nected with what is considered to be the 
welfare of that institution. 

Then, thirdly, this definition of attitude 
emphasizes its acquired or learned charac- 
ter. There are no psychic rays which en- 
able the investigator, even though he be 
equipped with a poll or a scale, to deter- 
mine the ‘strength’ of an attitude, the 
overt responses with which it has become 
associated, or its present functioning 
within the personality. Such knowledge 
can be obtained only from knowing ap- 
proximately under what conditions the 
attitude was acquired in the first place and 
the extent to which it secures present and 
future reinforcement. The learning proc- 
ess, therefore, is crucial to an understand- 
ing of the behavior of attitudes. 

The nature of that process cannot be 
ignored in a treatise on attitude as it has 
been by Sherif and Cantril: “Just what 
the psychological or physiological mecha- 
nisms of this learning may be are irrele- 
vant to the present discussion,” they write 
in their articles on “The Psychology of 
‘Attitudes’ ” (33, p. 302). It is difficult to 
see how psychologists can call these 
mechanisms ‘irrelevant’ and still contend, 
as the authors do in the introduction to 
the same articles, that the ‘task’ of the 
psychologist is to “give an adequate ac- 
count of the psychological mechanisms 
involved in the formation of an attitude 
in any individual” (33, p. 295). The au- 
thors rest their case by stating that they 
“do not need to take sides in favor of any 
learning theory” (33, p. 307). Of course, 
as they write, “the primary stage in the 
formation of attitudes is a perceptual 
stage,” which is merely saying that there 
must be a stimulus and that the stimulus 
must be perceived before there can be any 
kind of learning. 

In contrast, Allport (1, pp. 810-2) has 
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set the problem of the genesis of attitudes 
in terms which explicitly suggest the need 
for learning theory. His often quoted sum- 
mary of the literature indicates that atti- 
tudes may be formed through “the inte- 
gration of numerous specific responses of 
a similar type”; “individuation, differentia- 
tion, or segregation” of experiences; 
‘trauma’; and the adoption of ‘ready-made’ 
attitudes of others. The genesis of almost 
any attitude is undoubtedly more or less 
unique. Society sets the rewards and pun- 
ishments regarding much of overt be- 
havior; the individual being socialized then 
is forced into the learning situation; al- 
though he reacts to the situation uniquely, 
one of the end products—the attitude—he 
may share in large degree with others. 
3(a). “An attitude is an implicit re- 
sponse . . . which is evoked by a variety 
of stimulus patterns. . . .” The stimuli 
evoking an attitude may be in the external 
world or within the individual. The latter 
range from a verbal response to an au- 
tonomic disturbance or a drive. The exist- 
ing literature on attitudes testifies to the 
fact that the stimuli may be various. Such 
is the assumption behind any attitude 
scale in which a variety of situations is 
judged or behind a distinction like that 
between specific and general attitudes. 
The arousal of an attitude involves two 
traditional problems in psychology, those 
of perception and learning. The two are 
interrelated and can be separated only for 
purposes of analysis. Perception indicates 
that the individual is responding because 
he has previously paid attention to or 
been oriented toward certain stimuli 
which then affect his sense organs and 
thus evoke his attitude. Learning in this 
connection emphasizes the reasons in the 
past history of the individual which have 
brought about the bond between the 
stimulus pattern and the attitude. 
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Gestalt psychologists especially point 
out that paying attention and then per- 
ceiving occur in many instances as a result 
of the individual’s set to respond: letter 
boxes are not noticed unless the person 
has a letter to post, etc. Writers on atti- 
tude are fond of recalling that the tradi- 
tion of set is somewhat hoary in academic 
psychology, in order to demonstrate their 
own respectability and their acquaintance 
with long German terms like Bewusstseins- 
lage. In other words, perceiving depends 
upon drive or set (which orients the 
individual to respond to certain stimuli 
and then to respond to them in a particu- 
lar way) as well as upon the arrangements 
of the external stimuli. Attitude may be 
included among the sets determining both 
the orientation of the individual as well as 
the kind of perceptual response he makes: 
The southerner notices incipient aggres- 
sion in a Negro which a northerner will 
overlook. 

It must be recognized, however, that in 
some situations the individual’s attitude 
is not evoked until the stimulus has been 
actually perceived: It affects perception 
after its arousal but does not orient him 
originally in the direction of the stimuli 
involved. The southerner who has learned 
to discriminate incipient hostility from 
genuine docility among Negroes can make 
the discrimination when confronted with 
a Negro, It is on the basis of this discrimi- 
nation that his attitude toward the Negro 
is or is not aroused. If he goes about the 
streets looking for hostility in Negroes, he 
may be set to make the discrimination not 
necessarily by his attitude toward Ne- 
groes or by his ability to detect such be- 
havior but by some particular drive which 
has been previously aroused and which 
may or may not involve Negroes. To say 
that he searches for aggression solely be- 
cause of his attitude toward Negroes is to 


fail to distinguish him from another 
southerner who has a more or less identi- 
cal attitude (so far as content and even 
‘affect’ are concerned) but who has no 
‘chip on his shoulder.’ In this case the 
sensible problem remains of accounting 
for the ‘chip.’ 

In controlled experimental situations 
dedicated to observing the behavior of at- 
titudes, the attention of the subjects is 
secured by the experimenter not through 
arousing the attitude being studied but 
through the evocation of some other drive. 
Subjects perceived the autokinetic phe- 
nomenon of Sherif (30) or they looked at 
Seeleman’s photographs of white and col- 
ored individuals (29) because they had 
agreed to cooperate with the experimenter. 
This was the drive which oriented them 
in the experimental situation. Then their 
attitudes were aroused and these attitudes 
affected both their perceptual responses 
and the reports they gave the experi- 
menters, Later on in the experiments, 
their evoked attitudes may have had suffi- 
cient drive strength also to orient them 
selectively. 

3(b). “An attitude is an implicit re- 
sponse .. . which is evoked ... as a 
result of previous learning or of gradients 
of generalization and discrimination. . . .” 
The previous section has indicated the 
possible relation between perception and 
the evocation of an attitude and therein 
it was suggested that an attitude can al- 
most always be aroused by a variety of 
stimuli. Here it is stated that previous 
learning determines whether or not par- 
ticular stimulus patterns will evoke the 
attitude. Some stimuli come to arouse an 
attitude after a relatively simple process 
of conditioning has occurred. As a result 
of being originally present in the situa- 
tion, for example, the wrapper of the dis- 
liked fruit or the signature of the disliked 


person may produce an anticipatory re- 
sponse which mediates the goal response 
of avoiding it or him. Other stimuli evoke 
or fail to evoke an attitude not because of 
their presence or absence in previous sit- 
uations but because they fall along a stim- 
ulus gradient of generalization or discrimi- 
nation. If an individual likes or dislikes 
one particular Negro, there is stimulus dis- 
crimination; if all Negroes are involved, 
there is stimulus generalization along a 
gradient, for example, of skin color; if 
only certain ‘types’ of Negroes arouse the 
attitude, there is generalization and dis- 
crimination. 

Frequently attitudes are thought to be 
puzzling and mysterious because they can 
be aroused when the psychologist, the so- 
ciologist, the layman, and the individual 
least expect them to be. The stimulus pat- 
tern, for example, may be a word or a sen- 
tence, or some other symbol (like a flag, a 
face, or a gesture) which represents only a 
portion of the original stimulus pattern. 
The behavior of attitudes under these cir- 
cumstances, however, becomes more intel- 
ligible when the implications of the 
“gradient of generalization and discrimina- 
tion” are understood. This gradient is 
especially efficacious in the case of atti- 
tude since language can readily perform 
the function of mediating generalization 
and discrimination. Cofer and Foley (11), 
for example, are able a priori to list over 
fifty gradients along which generalization 
or discrimination from a single word can 
conceivably occur in purely formal (i.e., in 
non-idiosyncratic) manner. The word 
‘Negro,’ for example, through previously 
learning may become the one part of the 
original stimulus pattern which evokes an 
attitude regarding Negroes. Without any 
difficulty there can be a semantic gradient 
including words like ‘colored,’ ‘African, 
and the various epithets and appella- 


THE BEHAVIOR OF ATTITUDES 301 


tions applied to this group. Through a 
slightly more complicated process, eventu- 
ally ‘zoot suit’ may arouse the same atti- 
tude: if the individual has associated this 
type of clothing with Negroes, the re- 
sponse of seeing such clothing or hearing 
its name evokes the internal response of 
‘Negro’ which in turn has the property of 
arousing the attitude. This phenomenon 
has been called secondary stimulus gen- 
eralization or acquired cue value. Simi- 
larly, thinking can aid generalization and 
discrimination. 

Cantril in his work on attitudes fails to 
comprehend this stimulus gradient in- 
volved in most if not all learning and con- 
ditioning. He states, for example, that 
what he calls “a standard of judgment” 
must not be “confused with a conditioned 
response” (8, p. 25). What he means by 
“a standard of judgment” or a “frame of 
reference” he never makes operationally 
clear, although they seem to be related to 
attitude since they are employed profusely 
in his two articles on the subject. It may 
be that terms like these—to use Cantril’s 
own words in reference to ‘conditioning’— 
are “so loosely employed” that they “ex- 
plain nothing at all” (8, p. 55). His 
conception of a conditioned response is 
indeed narrow: “a specific reaction to a 
specific stimulus” (8, p. 25). In spite of a 
general, noncommittal reference in a foot- 
note to a standard book on conditioning 
(that of Hilgard and Marquis) and an 
irrelevant quotation from A. N. White- 
head, this simplification of behavior the- 
ory leads him to conclude that such a 
theory is “by no means adequate to ex- 
plain the apparent meaningfulness of 
man’s experience” (8, p. 56). More spe- 
cifically, for example, he maintains that 
the “analysis of the backgrounds of the 
people who became panicky listening to 
the Hallowe'en broadcast [of Orson 
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Welles in 1938] clearly shows that in no 
way had they been specifically condi- 
tioned against Martian invaders’ mowing 
down people on this planet” (8, p. 25). 
The point of Cantril’s study (7), how- 
ever, is to discover the previously existing 
attitudes and traits which made people 
prone to panic or sanity. After discovering 
many of them with admirable ingenuity, 
he gives a commonsense ‘explanation’ of 
the behavior; i.e., he uses his particular 
vocabulary to describe what happened (7, 
pp. 190-201). His failure to apply Chap- 
ter 8 of Hilgard and Marquis (15) to his 
own data prevents him from realizing that 
at the time of the broadcast people had 
learned to respond with anxiety to various 
stimuli as a result, for example, of the 
‘war scare’ associated with the Munich 
crisis (cf. 7, pp. 159-60). Certain Ameri- 
cans, some of whose socio-economic and 
psychological characteristics Cantril has 
indicated, apparently generalized from 
these stimuli to a broadcast which of 
course they had not previously experi- 
enced but which nevertheless was suff- 
ciently similar to other stimulus patterns 
previously evoking the anxiety. Such in- 
dividuals ‘jumped the gun’ by behaving— 
after their attitudes had been aroused by 
Mr. Welles and his associates—as they 
would have in the face of genuine catas- 
trophe. 

From experiments in other fields of be- 
havior, Hull states that the amplitude of 
a response “diminishes steadily with the 


increase in the extent of deviation . . . of 
the evocation stimulus . . . from the 
stimulus originally conditioned . . .” (17, 


p- 185) and that “The strength of the 
connections at other points of the zone 
can be determined only from a knowledge 
of the strength of the receptor-effector 
connection . . . at the point of reinforce- 
ment and the extent of the difference . . . 


between the position of the conditioned 
stimulus . . . and that of the evocation 
stimulus . . . on the stimulus continuum 
connecting them” (17, p. 187). Whether 
or not the principle holds true of attitudes 
has not been tested, so far as this writer 
knows. To test it, it would be necessary 
to know “the stimulus originally condi- 
tioned,” the gradient along which the 
various ‘evocation stimuli’ are located, 
and whether or not in fact these latter 
stimuli have never been previously rein- 
forced or extinguished. This could be 
done only by means of a careful life his- 
tory of various individuals and by some 
objective measurement of the strength of 
the attitude. 

At any rate, this generalization of Hull 
has an important bearing on the strength 
of attitude. The ‘strength’ of an attitude 
is almost as ambiguous as the concept of 
attitude itself. One type of strength that 
seems important for predicting future be- 
havior of the individual is the afferent- 
habit strength of the attitude, i.e., the 
strength of the bond between the stim- 
ulus pattern and the response which is 
here defined as attitude. In these terms 
the afferent-habit strength of an attitude 
is a function of the number of previous 
teinforcements as well as the position 
along the gradient occupied by a particu- 
lar stimulus pattern. 

4. “An attitude is an implicit response 

. which is itself cue- and drive-produc- 
ing. . . .” Like all implicit responses, atti- 
tudes can be said to have stimulus-value, 
i.e, they arouse other responses. The 
responses they evoke may indeed be vari- 
ous. They may produce a perceiving re- 
sponse, as has been suggested, and in this 
sense determine to what other stimuli 
the individual subsequently responds. 
They may produce linguistic responses, 
thoughts, images, or stereotypes. They 


eventually have an effect upon overt be- 
havior. Here again reference must be 
made to the habit strength of the attitude, 
only this time it is a bond between atti- 
tude as a stimulus and a response pattern 
(implicit or overt), rather than between a 
stimulus pattern and attitude as a re- 
sponse. This phenomenon will be called 
the efferent-habit strength and, like the 
afferent-habit strength, it too can be 
strengthened or weakened through learn- 
ing. The stimulus-value of attitude sug- 
gests why investigators have discovered so 
many different phenomena—aside from 
overt behavior—associated with attitude. 

The definition of attitude refers to the 
distinction made by Miller and Dollard 
(25, pp. 22-3) between the cue- and drive- 
producing characteristics of a stimulus. 
The numbers used in counting, they point 
out, have cue value: the number ‘six’ is a 
response to the cue of ‘five’ and in turn 
acts as a cue to elicit ‘seven.’ An attitude 
has cue-value in the sense that it acts as a 
stimulus to produce another response, but 
it also is a drive in the sense that its ten- 
sion is reduced through subsequent be- 
havior leading to a reward. It is proper, 
consequently, to refer to the drive strength 
of an attitude as well as to the strength 
of the bond between the attitude and the 
responses it evokes. An individual, for ex- 
ample, who has not been thinking of food 
is shown a picture of a type of food he 
likes. The picture may be said to evoke 
his favorable attitude toward the food 
which is a drive whose goal response is 
eating. If the secondarily evoked response 
pattern is only salivation and the thought 
or statement of how he likes the food, the 
drive may be considered relatively weak. 
But if he drops what he is doing and goes 
out to eat immediately after seeing the 
picture, the drive is relatively strong. 

The strength of an attitude, therefore, 
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may refer to its afferent-habit strength, 
its efferent-habit strength, or its drive 
strength. Knowledge of an attitude’s di- 
rection or content is not equivalent to 
measuring its strength. The attitude pos- 
sessed by two people, for example, may 
be more or less identical in formal content 
as measured by an attitude scale, but its 
role in determining overt behavior may be 
quite diverse. In one individual it may be 
evoked by a restricted stimulus pattern 
(specific attitude), it may not be fre- 
quently evoked (a weak afferent-habit), 
or the entire pattern of additional implicit 
and overt responses may be restricted (a 
weak drive). Any one or more of these 
conditions may be different in the second 
individual. Thus the role of the patriotic 
attitude in the average citizen is different 
from the way it functions within a pro- 
fessional patriot. Or within the same in- 
dividual the patriotic attitude may be 
more easily and variously aroused and 
lead more certainly to a greater number 
of responses during a war than when there 
is peace. 

The fate of an attitude over time— 
whether it persists or changes—is obvi- 
ously a function of complicated processes 
within the individual. At least three fac- 
tors are involved. The first is the reward 
or punishment associated with the goal 
response. An attitude will persist when it 
is constantly reinforced or it will change 
when it is partially or wholly extinguished. 
Its afferent- and efferent-habit strength is 
then increased or decreased. The efferent- 
habit strength is a direct function of the 
frequency with which the attitude has 
mediated rewarding or non-rewarding be- 
havior as well as of the immediacy and 
amount of the reward or non-reward. Af- 
ferent-habit strength depends ultimately 
upon efferent-habit strength since rein- 
forcement or non-reinforcement results 
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not from the arousal of the attitude but 
from the behavior mediated by the atti- 
tude; it also depends on the frequency 
with which particular stimulus patterns 
have aroused the mediating attitude and 
the distinctiveness of those patterns. In 
Hull’s words (16), attitudes have the 
property of ‘pure stimulus acts’ within a 
single individual: they are responses which 
are reinforced “because they, as stimuli, 
evoke other acts . . . which will bring 
about a reinforcing state of affairs. . . .” 

Secondly, there is the factor of conflict 
with competing drives which may deter- 
mine the fate of an attitude. The afferent- 
and efferent-habit strength of an attitude 
may be great, but its drive strength may 
be weak in comparison with other atti- 
tudes or drives aroused by the same or 
different stimulus patterns. The individ- 
ual, for example, may not express his atti- 
tude in overt behavior because its expres- 
sion would be contrary to his general 
philosophy; but his attitude persists. Fi- 
nally, there is forgetting which may in- 
volve other psychological processes besides 
extinction through non-reinforcement. 

It is possible, consequently, to have an 
attitude play a less significant role in a 
personality by diminishing the number of 
stimuli which evoke it, by having the at- 
titude aroused less frequently, by weaken- 
ing its drive strength, by setting up 
stronger competing drives, or by punish- 
ing the overt behavior which it mediates. 
Since the afferent-habit strength is af- 
fected by the final goal response, more- 
over, it follows that the attitude’s strength 
in this respect can remain more or less 
constant even though its efferent-habit 
strength vis-à-vis a particular response pat- 
tern is weakened: it is only necessary that 
some reinforcement be obtained by hav- 
ing the attitude mediate other goal re- 
sponses. The prejudiced individual, for 


example, can retain his prejudice not by 
always behaving identically in response to 
a given stimulus pattern in his society but 
by behaving differently and with more or 
less equal satisfaction. 

There is a voluminous literature on the 
subject of attitude change, a good part of 
which is called experimental (cf. 26, pp. 
946-80). In general, the approach has 
been to subject a group of individuals to 
a collection of stimuli (like a course in 
race relations, a motion picture, propa- 
ganda analysis, or a visit to an ethnic 
group in a large American city). Their 
changes in attitude (if any) are ascer- 
tained by comparing their scores on an 
attitude scale before and after being sub- 
jected to the stimuli. Sometimes the 
changes are compared with those of a 
control group which has not been so stim- 
ulated. It must be said that this type of 
approach is socially useful but psycho- 
logically sterile: it is important to know 
that lectures or visits do or do not affect 
students but, except for sporadic attempts 
to correlate attitude change with obvious 
factors like intelligence and ‘intensity’ of 
the attitude at the outset, no effort has 
been made to suggest precisely why the 
attitudes do or do not change. They 
change, it is said, ‘because’ the student 
heard the lecture or met a Negro or saw 
a motion picture. Obviously the word ‘be- 
cause’ is misleading. All that has been 
demonstrated is a correlation, not a causal 
connection. Two people with approxi- 
mately the same attitude and subject to 
approximately the same stimulus pattern, 
for example, will be affected differently 
because different responses, including ot 
excluding the attitude, are evoked within 
them. Or the overt effect may be the 
same for different reasons: in one, the af- 
ferent strength of the attitude may be al- 
tered only in respect to particular stimu- 


lus patterns and not to others; whereas in 
another, the drive strength of the attitude 
may be reduced. To maintain, therefore, 
that a course or a contact produces atti- 
tude change in a group of individuals 
(with a large or small sigma) is to state 
an historically limited conclusion which 
certainly may be socially useful at a given 
moment. It is like indicating that the 
tion of a slum area diminishes the 
quency rate; it does, but thereby 
ght is gained into the nature of 
uency (e.g, why there are delin- 
quents from non-slum areas). Research 
on attitude change, consequently, is likely 
to produce superficial generalizations 
which, being derived so uniquely from 
particular phenomena, can be applied to 
future situations only with extreme diffi- 
culty, 

The psychological aspects of this defini- 
tion of attitude, finally, can shed some 
light on another traditional problem: the 
relation between attitude and stereotype. 
Numerous studies, especially those of 
Katz and Braly (18) and of Child and 
Doob (10), have demonstrated the close 
connection between the two. The term 
“stereotype” is loosely employed. Like at- 
titude, it seems to be an implicit response 
—this is what Lippmann (23) many years 
ago must have meant by defining it as 
“the picture in our heads.” It becomes an 
attitude, however, only when it is also 
drive-producing. An individual, for exam- 
ple, has a favorable attitude toward Great 
Britain, it is said in over-simplified fash- 
ion, because he considers the British 
“patriotic.” If the oversimplified explana- 
tion be accepted as valid, some learning 
process in the past must be presumed. A 
word like “good” must first have pro- 
duced a “favorable” response since it was 
conditioned to a stimulus pattern like 
parent or food which for other reasons 
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evoked that response. Then “patriotic” 
became associated with “good” for rea- 
sons to be found in the individual’s milieu 
and also evoked that response. “Great 
Britain” as a stimulus came to produce 
the response of “patriotic” (the stereo- 
type), a bit of learning doubtlessly also 
socially conditioned. “Patriotic” thus is a 
stimulus-producing response which, fi- 
nally, evokes the “favorable” response to 
which it has been previously linked. In 
this instance, the stereotype evoked by 
“Great Britain” is a mediating response in 
a long response sequence and does evoke 
a drive. In like manner, most people in 
our society reply to the question, “Is the 
earth round or flat?” by means of some 
stereotype which produces the word 
“round.” The stereotype appears to have 
cue but essentially no drive-value and 
hence is not an attitude, although the 
question itself may arouse another im- 
plicit response with drive-value (atti- 
tude): to reply incorrectly to a simple 
question is usually non-rewarding. 

5. “An attitude is an implicit response 

. which is considered socially signifi- 
cant in the individual's society.” If atti- 
tudes are defined as implicit, drive-pro- 
ducing responses, it is obvious that they 
thereby are placed within the psychologi- 
cal sub-class of such responses but that 
simultaneously they are not distinguished 
from other responses in this group. The 
other psychological qualifications which 
have been discussed—their anticipatory 
and mediating character, the variety of 
stimuli which evoke them, and the va- 
riety of responses they evoke—are also 
common to other responses which, ac- 
cording to conventional usage, may not be 
considered attitudes, The rat’s aversion to 
a grid on which it has been shocked is 
doubtless implicit, it is anticipatory and 
mediating in avoiding the shock, it can 
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be evoked by a gradient of stimuli, and it 
has drive value resulting in other re- 
sponses which serve perhaps to allay its 
anxiety; but it is ordinarily not useful to 
call such a response an attitude. Similarly 
the human being’s favorable disposition 
toward cream cheese or a style of hat may 
or may not be called an attitude. Psycho- 
logically, therefore, attitude is not and— 
it is deliberately maintained—should not 
be distinguished from the larger sub-class 
of responses to which it appears to belong. 

The distinction between attitude and 
other types of responses can be made not 
on a psychological but on a social basis: 
its socially evaluated significance must be 
considered. The rat’s aversion to the grid 
is not an attitude unless it plays an impor- 
tant part in its behavior in other situa- 
tions involving rats; from the human 
standpoint, it is not at all socially signifi- 
cant. The liking of cream cheese or a hat 
may or may not be considered socially 
significant: from an overall point of view, 
it is doubtless trivial and hence not an 
attitude, although it undoubtedly is of im- 
portance to cheese producers and hat 
manufacturers as well as their clients. The 
words “socially significant” must be left 
unspecific, since social values fluctuate 
from society to society and, within a par- 
ticular society, over time and in various 
groups. Almost always the socially signifi- 
cant in a society is evaluated or, more 
simply, is called “good” or “bad” to indi- 
cate its actual or potential effect on people. 
A useful test to decide whether an im- 
plicit response with drive-value is an atti- 
tude is to discover whether that response 
is labelled desirable or undesirable by the 
individual’s contemporaries. In any seg- 
ment of society at a given moment, peo- 
ple are likely to acquire attitudes because 
they are subject to similar learning condi- 
tions! s: 


w 


13: 


1 


16. 


17: 


18. 


23. 


24. 


2 


{v 


v 


REFERENCES 


. Allport, G. W. Attitudes. In A hand- 


book of social psychology (Murchi- 
son, C., Ed.). Worcester: Clark Univ. 
Press, 1935. Chap. 17. 


. Bernard, L. L. An introduction to social 


psychology. New York: Henry Holt, 
1926. 


. Cantril, H. Experimental studies of 


prestige suggestion. Psychol. Bull., 
1937, 34, 528. 


. Cantril, H., Gaudet, H., & Herzog, H. 


The invasion from Mars. Princeton: 
Princeton Univ. Press, 1940. 


. Cantril, H. The psychology of social 


movements. New York: Wiley, 1941. 


. Child, I. L., & Doob, L. W. Factors de- 


termining national stereotypes. J. soc. 
Psychol., 1943, 17, 203-219. 


. Coffer, C. N., & Foley, J. P., Jr. Medi- 


ated generalization and the interpre- 
tation of verbal behavior: I. prolegom- 
ena. Psychol. Rev., 1942, 49, 513- 
540. 

Doob, L. W. Some factors determining 
change in attitude. J. abnorm. & soc. 
Psychol., 1940, 35, 549-565. 

Hilgard, E. R., & Marquis, D. G. Condi- 
tioning and learning. New York: Ap- 
pleton-Century, 1940. 

Hull, C. L. Fractional antedating goal 
reactions as pure stimulus acts. Paper 
delivered before Monday Night Meet- 
ing of the Institute of Human Rela- 
tions, Oct. 24, 1941. 

Hull, C. L. Principles of behavior. New 
York: Appleton-Century, 1943. 

Katz, D., & Braly, K. W. Racial preju- 
dice and racial stereotypes. J. abnorm. 
& soc. Psychol., 1935, 30, 175-193. 

Lippmann, W. Public opinion. New 
York: Macmillan, 1922. 

May, M. A. A stimulus-response inter- 
pretation of “attitudes.” Unpublished 
paper. 

Miller, N. E., & Dollard, J. Social learn- 
ing and imitation. New Haven: Yale 
Univ. Press, 1941. 


ATTITUDE FORMATION: THE DEVELOPMENT OF COLOR PREFERENCE RESPONSE 


26. Murphy, G., Murphy, L. B., & New- 
comb, T. B. Experimental social psy- 
chology. New York: Harpers, 1937. 

27. Murray, H. A., & Morgan, C. D. A 
clinical study of sentiments. Genet. 
psychol. Monogr., 1945, no. 32. 

28. Richards, I. A. Science and poetry. New 
York: Norton, 1926. 

29. Seeleman, V. The influence of attitude 
upon the remembering of pictorial 


307 
material. Arch. Psychol., 1940, no. 
258. 

30. Sherif, M. A. A study of some social 
factors in perception. Arch. Psychol., 
1935, no. 187. 

32. Sherif, M. A. The psychology of social 
norms. New York: Harpers, 1936. 

33. Sherif, M. A., & Cantril, H. The psy- 
chology of “attitudes.” Psychol. Rev., 
1945, 52, 295-319; 1946, 53, 1-24. 


29. 
Attitude Formation: The Development of a Color 
Preference Response through Mediated Generalization*’ 


Bernice Eisman Lott 


The present investigation of attitude 
development has had as its major stimu- 
lus Doob’s 1947 discussion (7) and rein- 
terpretation of the concept. His place- 
ment of attitude within the framework of 
behavior theory and his emphasis on atti- 
tude as a learned response to definable 
stimuli appears to be a more research ori- 
ented and potentially fruitful approach 
to the problem than has been taken in 
the past. An equally important source of 
stimulation for this study has come from 


* From B. J. Eisman, Attitude formation: 
The development of a color preference te- 
sponse through mediated generalization, 
J. abnorm. soc. Psychol., 50, 321-326 
(1955). Reprinted by permission of the 
author and the American Psychological 
Association. 


the work on mediated and semantic gen- 
eralization, particularly from the work of 
Birge (2), Cofer and Foley and asso- 
ciates (3, 4, 5, 8, 9), Keller (11), Razran 
(13, 14), and Riess (15, 16). 

An attitude is here defined, as sug- 
gested by Doob, as a learned implicit 
anticipatory response having both cue 
and drive properties. An anticipatory re- 
sponse is one which originally came after 
a rewarded response but as a result of 
being most closely associated with the 
reward moves forward in the behavior se- 
quence. This results in its “anticipatory” 


1 This paper is based on a portion of a 
dissertation, prepared under the guidance 
of Professor F. Fearing, and submitted in 
partial fulfillment of the requirements for 
the Ph.D. degree, U.C.L.A., 1953. The 
author also wishes to thank Professors 
Gilhousen, Maltzman, Centers, Seagoe, 
and Turner for their critical suggestions, 
and Miss C. Seeds, Principal of the Uni- 
versity Elementary School, for her coopera- 
tion in supplying the subjects for the re- 
ported experiment. 
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occurrence directly to the external stimu- 
lus before its original time in the re- 
sponse series, As a response with stimulus 
properties, an attitude falls into the class 
of “pure stimulus acts” defined by Hull 
(10) as responses whose major function 
is to serve as stimuli for other acts. It 
follows, therefore, that once such an im- 
plicit response-produced stimulus (rs) 
has been established, it can be condi- 
tioned to evoke overt behavior. In this 
way an attitude acts as a mediator of re- 
sponses. It is these responses, mediated 
by an attitude, which are measured by 
attitude questionnaires in attitude experi- 
ments, etc. 

The property of drive value ascribed to 
an attitude is derived from the fact that 
an attitudinal response is assumed to pro- 
duce strong stimulation. Any strong, per- 
sistent stimulus is considered by Miller 
and Dollard (6, p. 30) to constitute a 
drive. Reduction of the strong stimulus 
is drive reducing and therefore reinforc- 
ing. It is expected, therefore, that any 
overt response which leads to a significant 
reduction of the strong stimulus will be 
learned. Ascribing drive value to attitudes 
distinguishes them from other implicit, 
anticipatory response-produced stimuli 
and is in line with traditional views. Atti- 
tudes, wrote Allport (1), “both motivate 
and guide; they supply both drive and 
direction.” Sherif and Cantril (17, p. 
300) offer, as one criterion of an attitude, 
its affective property. Krech, too, speaks 
of attitudes as motivational, thus distin- 
guishing them from beliefs (12, p. 152). 


Statement of the Problem 


The purpose of the present study has 
been to demonstrate experimentally that 
attitude formation is amenable to labora- 
tory observation and control, and can be 


adequately conceptualized and explained 
by reinforcement learning theory. The 
general hypothesis of this study can be 
formally stated as follows: A positive 
preference or attitude toward an object 
with which an individual has had only 
neutral experience can be developed 
through mediated generalization. In more 
operational terms, it is predicted that if 
individuals are taught to attach the same 
label to two stimuli which differ from one 
another in all other relevant ways, and if 
these individuals subsequently have re- 
warding experience with one of these 
stimuli, then a positive preference for the 
other stimulus, as well as for stimuli re- 
sembling the latter, will be demonstrable. 
This type of learning experience follows 
the general paradigm for mediated gen- 
eralization. In this study the subjects de- 
velop a positive response for a color after 
being subjected to such a series of learn- 
ing experiences. 

To test this general hypothesis four dif- 
ferent test situations, in which a color 
preference could be demonstrated, were 
employed. These situations, differing in 
context, complexity, and social signifi- 
cance, will be described in detail below. 


Method 
APPARATUS AND SUBJECTS 


A wooden stage, 20.5 in. high, 30 in. 
wide, and 19 in. deep, with a raised, 
slanted platform, at an angle of about 35 
degrees from the horizontal, was con- 
structed and used for the presentation of 
various stimulus objects to the subjects. 
An unbleached muslin curtain could be 
pulled in front or away from the platform 
in order to hide or expose objects on it. 
Three small depressions about 8 in. apart 
were drilled into the platform to serve as 
receptacles for marbles which were used 
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as rewards during certain portions of the 
training. 

The following stimulus objects were 
used: (a) three wooden geometrical 
blocks, each painted white and .75 in. 
thick, triangular, circular, and square, re- 
spectively; (b) three thin rectangular 
blocks, each 2.5 in. by 6 in. and .75 
in, thick, painted green, yellow, and 
black, respectively; (c) three metal jar 
tops, 2.5 in. in diameter, also painted 
green, yellow, and black, respectively; (d) 
three glasses, 3.5 in. high, painted green, 
yellow, and black, respectively; (e) three 
thick rectangular blocks, 1.5 in. by 1.5 in. 
by 4.5 in, painted green, yellow, and 
black, respectively; (f) three white 
wooden “nonsense” blocks, .75 in. thick, 
and of three different nonsense shapes. 

Eighty-one subjects (Ss) were used, 41 
boys and 40 girls, ranging in age from 5 
years, 10 months to 8 years, 10 months. 
All Ss were attending an elementary 
school operated by the Department of 
Education of U.C.L.A. All members of 
each of the classes used in this study were 
utilized by the experimenter (E), i.e., 
there was no arbitrary selection of Ss from 
within any class. The Ss were told that E 
had a new game she wanted to try out and 
that she would play with each of the chil- 
dren in a class, one at a time. Owing to 
the nature of the school, all children in it 
were accustomed to observation by stran- 
gers and many of them were also accus- 
tomed to leaving their classes for some 
time for testing or other “play’-research 


purposes. 


PROCEDURE 


The 81 Ss were randomly divided into 
four groups with 9 Ss in Group I, 18 Ss 
in Group II, and 27 Ss each in Groups III 
and IV. One third of the Ss in each group 


309 

was randomly selected to be trained posi- 
tively for each of the three colors, yellow, 
green, and black. The E worked with one 
S at a time. Since the name of each S had 
been assigned to an experimental group 
prior to the start of the experiment, the 
order in which Ss came to E was not 
fixed, and either the teacher or the last S 
chose the next S. 


Part 1. Name learning 
for the geometrical blocks 


Each S sat facing E and the front of the 
stage. The Ss in all four groups were 
treated alike during this portion of the 
training. The three geometrical blocks 
were placed on the stage by E, and S was 
told that all three had names which S had 
to discover, the names being “egg” (for 
the triangle), “car” (for the circle), and 
“shoe” (for the square). Each S was 
shown one block at a time in a predeter- 
mined random order which was the same 
for all Ss. When a block was presented, S 
guessed at its name and E told S if he was 
right or wrong. The S was given as many 
trials as was necessary in order for him 
successfully to identify each of the three 
blocks five times in succession. Each S was 
told that learning the names of the blocks 
was necessary in order to proceed to the 
next part of the game during which he 
could win some marbles. 


Part 2. Reward series 


Here, too, Ss in all four groups were 
treated alike. The geometrical blocks 
were again placed on the platform and S 
was told that E would hide a marble un- 
der one of them when the curtains were 
closed and then ask S to guess where the 
marble was. The S was instructed to point 
to the block under which he thought the 
marble was hidden and to call the block 
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by its name, the name learned in Part 1. 
When placing a marble under the proper 
block, E was careful to make extraneous 
noise so that sound would not serve as a 
reliable cue with respect to the hiding 
place of the marble. 

A marble was always hidden under the 
same block for any given S. For those who 
were to be trained to prefer green, the 
marble was always placed under the tri- 
angle (“egg”); for those to be trained for 
yellow, the marble was placed under the 
circle (“car”); and for those to be trained 
for black, the marble was always placed 
under the square (“shoe”). The relative 
positions of the blocks were shifted per 
trial according to a random, predeter- 
mined order which was constant for all Ss. 

Each time a marble was hidden S was 
permitted only one guess as to its loca- 
tion. If S guessed correctly, he kept the 
marble; if he guessed incorrectly, E closed 
the curtains and hid the marble again, 
under the same block but in a new posi- 
tion with respect to the other two. The 
reward series ended when S had made six 
consecutive correct guesses. If the cri- 
terion was not reached by the fourteenth 
trial, a correction procedure was insti- 
tuted, i.e., when S guessed incorrectly, E 
lifted the correct block and showed S 
where the marble was. 

The purpose of this part of the training 
was to provide differential reinforcement 
for one of the three names (“egg,” “car,” 
or “shoe” ) which S had learned in Part 1. 
This is the only portion of the training in 
which such differential reinforcement 
could be obtained. 


Part 3. Name learning 
for the thin rectangular blocks 


Immediately after the reward series, E 
presented the three colored rectangular 


blocks, instructing S that one was called 
“egg” (the green block), one was called 
“car” (the yellow block), and one was 
called “shoe” (the black block). The S 
was again asked to discover which block 
had what name. The procedure followed 
here was identical to that followed in Part 
1 and again Ss in all four groups were 
treated alike. 


Part 4. Review series. Groups I and II 


Immediately following Part 3, Ss in 
both of these groups were tested for recall 
of the names of the geometrical blocks 
and of the colored rectangles and for re- 
call of the marble game (reward series). 

Groups III and IV. For Ss in these 
groups a longer and more elaborate re- 
view was given in order to introduce more 
reward and color-naming experience. This 
was done because the results of a pre- 
liminary investigation had led to the con- 
clusion that owing to the nature of the 
test situations (to be described below) 
given Ss in Groups III and IV, additional 
reward and naming experience would be 
necessary for mediated generalization to 
be demonstrable. 

The E presented three new stimuli, the 
colored jar tops, and asked S to guess 
what their names were. The S received a 
marble each time he correctly named all 
three stimuli. When S reached the cri- 
terion of three correct identifications, the 
colored glasses were presented and the 
same procedure was followed. The E next 
presented the three thick rectangles and 
asked S to guess their names. Correct 
identifications were calling the green ob- 
jects “egg,” the yellow ones “car,” and the 
black ones “shoe.” 

The Ss were then reviewed on the mar- 
ble game (reward series). Then one jar 
top, one glass, and one rectangle, each of 
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a different color, were presented. All three 
of the possible combinations were pre- 
sented successively and S was asked to 
name the objects. No marble rewards were 
given. 


Part 5. Test for mediated 
generalization and color preference 


Here the major differential treatment 
for the four experimental groups was in- 
troduced, The tests were given immedi- 
ately after the review. 

Group I. The Ss in this group were 
presented with the three thin rectangular 
blocks used in Part 3 and told, “Now 
we'll play the marble game with these. 
You tell me where you think the marble 
is. Don’t forget to tell me the name of 
the block you think the marble is under.” 
With the curtains hiding the platform, E 
placed a marble under each block. Only 
one trial was given, and after S made his 
choice he was told that there would be 
no more games. A right choice was pick- 
ing that colored rectangle which had the 
same name as the geometrical block under 
which S had consistently found marbles 
in Part 2. 

Group II. The Ss in this group were 
also told that they were going to play the 
marble game again. The curtains were 
drawn, but instead of placing the three 
thin rectangles on the platform, as was 
done with Group I, E substituted three 
new stimuli, the colored jar tops, with 
which Ss in Group II had had no prior 
experimental experience. A marble was 
placed under each jar top. When the cur 
tains were opened, S was told to choose 
that jar top under which he thought a 
marble was hidden and to give its name 
(“egg,” “car,” “shoe”). The E did not 
tell Ss that these were the names of the 
new objects, and Ss had had no experi- 
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ence in so naming them. Only one choice 
trial was given. A correct choice was pick- 
ing that jar top which was the same color 
as the rectangle which S, in Part 3, had 
learned had the same name as the geo- 
metrical block under which marbles had 
consistently been found in Part 2. 

Group III. The Ss in this group were 
presented with three new stimuli, the 
white “nonsense” blocks, and instructed 
that one was called “green,” one “black,” 
and one “yellow.” The S was told that he 
had to discover which block had what 
name. The same name-learning procedure 
as was used in Parts 1 and 3 was utilized 
here, and again a criterion of five succes- 
sive correct identifications of each block 
was employed. After S reached the cri- 
terion, he was asked, “If you could take 
one of these blocks home, which would 
you pick?” 

The color name learned for each of the 
three “nonsense” blocks was varied from 
S to S in order to correct for possible pref- 
erence for one of the blocks because of its 
shape. Thus, for example, of three sub- 
jects, all trained to prefer black (“shoe”) 
by having been given differential rein- 
forcement for the square block (“shoe”) 
in Part 2, each learned to call a different 
“nonsense” block “black” in this test sit- 
uation. Each of the three Ss was expected 
to choose that block which he had learned 
to call “black.” 

Group IV. The E told Ss in this group 
a story about a pair of twins who had just 
moved into a new neighborhood. During 
the course of the story the twins meet 
three groups of children, a green, a yel- 
low, and a black group. The play activities 
described for the three groups are almost 
identical. The climax of the story is 
reached when the twins decide to have a 
birthday party and their parents insist that 
they can invite only one of the groups of 
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their new friends. The twins must choose 
only one of the groups for their party. 
Each S was asked by E to choose the 
group he would invite. A correct choice 
was picking that group having the same 
color as the rectangular block which S had 
learned, in Part 3, had the same name as 
the geometrical block under which he had 
consistently found marbles in Part 2. 


RESULTS 


Table 1 summarizes the generalization 
results obtained from Ss’ responses in 
their respective test situations. The num- 
bers in parentheses represent expected 
frequencies. It was expected that since 
each S had to choose among three colors 
or three colored objects in the test situa- 
tion, one third of the group could choose 
the correct (i.e., trained for) color and 
two thirds of the group could choose the 
incorrect color by chance alone. A signifi- 
cant deviation from these proportions in 


the direction of more than one third 
Yeses and less than two thirds Noes re- 
futes the null hypothesis and lends sup- 
port to the experimental hypothesis. 

It can be seen from Table 1 that the 
performance of all groups verified the 
experimental hypothesis. The null hy- 
pothesis of no significant difference be- 
tween obtained and theoretical frequen- 
cies can be safely rejected, and the 
training given each group is thus shown 
to be adequate for the generalization of a 
positive choice response from one stimu- 
lus to a previously neutral one. 

A chi-square test of independence was 
also run on the data shown in Table 1 to 
see if there were any significant differ- 
ences among the four groups in the suc- 
cess-failure ratio. No such differences were 
found (x? = 3.0; p > .30). A test between 
Groups I and II combined and Groups 
III and IV combined also yielded insig- 
nificant results, although there is an indi- 
cation that the more difficult task re- 


TABLE 1 


Generalization Results: Responses of Subjects in All Groups in 
Their Respective Test Situations 


NO. OF Ss No. OF Ss 
MAKING MAKING 
CORRECT INCORRECT 
GROUP N CHOICE CHOICE x2 p* 
I 9 8 (3) 1 (6) <.002** 
Il 18 14 (6) 4 (12) 16.00 <.001 
Ul 27 16 (9) 11 (18) 8.17 <.01 
IV 27 TZ (9) 10 (18) 10.67 <.01 


* Probability that the difference between obtained and expected fre- 
quencies could have occurred by chance alone. 

** Since the theoretical frequencies and total N of Group I are too low 
for the reliable use of x2, the probability figure shown was obtained by 
evaluating the data by means of the binomial expansion (both tails of the 


distribution considered) . 


From Eisman: Attitude formation: The development of a color preference 
response through mediated generalization. 
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quired of Ss in these latter two groups 
served to lower the number of correct 
responses (x? = 3.37; p > .05) 2 


GENERAL DISCUSSION AND 
CONCLUSIONS 


The results of this experiment have 
shown that conditions which allow for 
mediated generalization, and which, in 
certain cases, offer Ss additional oppor- 
tunities for reward and “labeling” experi- 
ence, are sufficient to produce a positive 
response toward a previously neutral color 
with which Ss had had no differential 
reward experience. From this positive re- 
sponse; a favorable “attitude” towards this 
color is inferred. In addition, this favor- 
able attitude has been demonstrated in 
more than one type of situation. 

Space limitations do not permit a full 
presentation of the analysis of the results 
of this study in terms of learning theory 
concepts and principles. One illustration 
of the kind of analysis performed will have 
to suffice. 

Figure 1 represents the conditions for 
and results of training for Ss in Group IV. 
Stage A represents Parts 1 and 3 of the 
experimental training, ie. the name- 
learning sessions; Stage B represents Part 
2, the reward session; and Stage C repre- 
sents Part 5, the test situation. Stage A 


2 The influence of age and sex on gen- 
eralization in this experimental situation 
was tested by means of chi square. No 
significant differences were found to exist 
between Ss above and below the median 
age of their respective groups with respect 
to success and failure on the generalization 
tests. Similarly, no significant difference in 
the success-failure ratio was found to hold 
between the sexes. 
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might have been better represented by 
three diagrams—one for each geometrical 
block and colored rectangle pair to which 
S learned to give the same name. For con- 
venience, only one diagram, however, is 
used to represent all three. In stage B only 
one S, is referred to, depending upon 
which geometrical block a particular S was 
consistently rewarded for choosing. 

In stage C, the test situation, color 
names of three groups of children in a 
story were presented as oral stimuli to the 
Ss by E. Sen represents these color-name 
stimuli. Each of the color-name stimuli 
can evoke a specific rps, because of the 
relationship shown in Fig. 1 under the 
heading “conditioning assumed to have 
occurred prior to the experiment.” It is 
assumed that the Ss, outside the experi- 
mental situation, have learned to make 
this same response to both S, (a visual 
color stimulus) and Sen (an auditory 
color stimulus, i.e., a color name). This 
same response is Ren (naming the color, 
for example, “yellow”). If we now invoke 
the principle of mediated generalization 
we can say that any response subse- 
quently conditoned to S, will also be 
evocable by Sen. In stage A such a new 
response was conditioned to Sa, namely 
the “egg,” “car,” or “shoe” response, Ra. 
As a result, when Sen is presented in stage 
C, it can evoke the implicit and anticipa- 
tory component of R,, namely f-Sn- 

Once we have thus accounted for the 
evocation of fm-Sn, we can see how this can 
evoke the anticipatory component of Re, 
namely Tea-Sca, the “attitude.” This stems 
from the conditioning which took place 
in stage B and from the anticipatory na- 
ture of rerSen. In this situation we see that 
TonSen evokes, not the old Re+ of stage B, 
but a slightly different choice response 
(Rex). Both choice responses can be un- 
derstood as being part of a habit family 
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associated with the same stimulus, TerSer» 
the “attitude.” The evocation of the cor- 
rect choice response, Rew, cannot be fully 
explained without assuming, as we have 
done, its evocation by its implicit com- 
ponent, the attitudinal response-produced 
stimulus fon-Ser. 

There is one part of our diagram which 
has thus far been ignored. We have said 
that in stage B r,-s, becomes conditioned 
to Ren and that similarly Ter-Sen becomes 
conditioned to Ry. That this is indeed the 
case was demonstrated by the fact that 
many Ss, when choosing the colored 
group of their choice also used an “egg,” 
“car,” or “shoe” name to refer to it. Stage 
C, therefore, has been diagrammed to in- 
clude the evocation of Ry by rea-Sen. 

Analyses of the conditions and results 
of training for Ss in Groups I, II, and II 
involve the application of similar princi- 
ples. 

It is hoped that the present study repre- 
sents a step in the direction of experi- 


FIG. 1. Conditions for and results of 
training for Ss in group IV. S stands for 
stimulus of either geometric blocks (g) or 
colors (c); R stands for overt responses 
of either naming (#) or choosing (ch); r 
stands for implicit responses and s stands 
for stimuli produced by these implicit 
responses. From Eisman: Attitude for- 
mation: The development of a color 
preference response through mediated 
generalization. 


mentally validating certain principles of 
learning theory on a human level in more 
or less uniquely human situations. The 
author has shown that at least one of 
these principles (mediated generalization ) 
can be used to predict a certain type of 
human behavior, preference for a class of 
stimuli with which individuals have had 
only neutral experience. This type of be- 
havior is common and shows itself most 
dramatically in the exhibition of attitudes 
toward social or ethnic groups with which 
individuals have had little or no direct 
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experience. That such attitudes may be 
directly taught by parents or other 
“teachers” and maintained by group rein- 
forcement is one possibility. That they 
may also be formed in the indirect man- 
ner experimentally demonstrated by this 
study is another. It is not too big a step 
to assume that if children can learn to 
prefer the color yellow, for example, over 
the colors green and black as a result of 
the type of training given them in this 
investigation, they can also, as a result of 
similar training, learn to prefer people 
called Englishmen over those called Poles 
and Italians, even though they have had 
no differential reward or punishment ex- 
perience with any of those three national 
groups. The essential requirement for this 
learning is that individuals should learn 
to attach the same labels to the word 
“Englishman” as to stimuli with which 
they have rewarding experience, and to 
attach the same labels to the words “Pole” 
or “Italian” as to stimuli with which they 
have had neutral or punishing experience. 


SUMMARY 


Eighty-one elementary school children 
of grades 1, 2, and 3 were trained to label 
a white triangular block and a green rec- 
tangular block “egg,” to label a white 
square block and a black rectangular block 
“shoe,” and to label a white circular block 
and a yellow rectangular block “car.” In a 
subsequent situation all Ss were rewarded 
for choosing one particular geometrical 
white block. The Ss in Group I were then 
tested for mediated generalization by be- 
ing asked to choose which of the colored 
rectangles they thought would bring a re- 
ward. The Ss in Group II were presented 
with three new, i.e., previously unexperi- 
enced, color stimuli and asked to guess 
which one would bring a reward. The Ss 
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in Group III learned to label three differ- 
ent white “nonsense” blocks “yellow,” 
“black,” and “green,” respectively, and 
then were asked to choose the block they 
would like to take home. The Ss in Group 
IV were told a story about three groups of 
children, a yellow, a black, and a green 
group, and then asked which group they 
would invite to a hypothetical birthday 
party. 

For each group it was predicted that Ss 
would choose that stimulus in the test 
having the same actual color or color 
name as the colored rectangle which they 
had learned had the same “egg,” “car,” or 
“shoe” name as the geometrical block for 
the choice of which they had previously 
been rewarded. These predictions were 
verified. Significantly more Ss in each 
group made the correct choices in the 
test than would have been expected by 
chance. 

The investigation was designed to test 
the general hypothesis that a color-prefer- 
ence response (positive attitude) could be 
developed through mediated generaliza- 
tion, and that this preference could be 
demonstrated in four situations differing 
in context, complexity, and social signifi- 
cance. An analysis, in terms of reinforce- 
ment learning theory principles and con- 
cepts, of the experimental conditions and 
results for Group IV was presented as il- 
lustrative of the type of analysis necessary 
for a full explanation of the behavior of 
Ss of all four groups in their respective 
test situations. 
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Public opinion researchers are familiar, 


through anecdote if not personal ac- 


1 The author is indebted to Prof. Mau- 
rice P. Smith for his suggestions regarding 
design and report of the study, and to the 
following graduate teaching fellows who 
assisted in the collection of data: H. Hess, 
P. Khanna, A. Mathews, and I. Richard- 
son. 
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quaintance, with the woman who, when 
asked her opinion on social security, re- 
plied that she didn’t know because no 
one had ever asked her, and she never 
knew what her opinions were until she 
opened her mouth and expressed them. 
Perhaps this apocryphal respondent was 
displaying more insight into the psycho- 
logical processes underlying her attitude 
than is readily apparent. Though cogni- 
tive approaches to attitude development 
are more flattering in their emphasis on 
the rationally cognized relation of an ob- 
ject to the person’s goals (1, 3, 8, 9), non- 
mal determiners may be equally im- 
portant in the acquisition of attitudes. 

According to Doob (4) an attitude 
may be regarded, like a habit, as an im- 
plicit anticipatory response which medi- 
ates overt behaviors, and arises out of 
them: through response reinforcement. 
Thus, it is conceivable that an opinion 
be expressed initially, in the absence of a 
supporting attitude, but if the verbal be- 
havior is rewarded, the corresponding at- 
titude may develop and mediate subse- 
quent opinion expressions in the presence 
of similar cues. This response reinforce- 
ment formulation thus focuses more on 
reward of verbal expressions than on cog- 
nized means-end relationships as critical 
factors in attitude development. 

The two formulations, and the sets of 
variables they employ, are by no means 
incompatible. It is reasonable to suggest, 
for instance, that lacking a well structured 
and salient set of cognitive associations 
regarding an object, a person may be more 
readily induced to respond to it in non- 
logical fashion, the outcome of his re- 
sponse then contributing to a nascent 
cognitive structure; but given a set of 
values and cognitions that can readily be 
applied to a new object, these will in- 
fluence the person’s attitudinal set and 
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thus produce a response consistent with 
the pre-existing cognitive structure. It is 
not the purpose of this paper to propose 
a systematically inclusive formulation of 
these two classes of determinants, but 
rather to offer evidence concerning the 
efficacy of response reinforcement in the 
determination of attitudes. 

Other studies (2, 5, 10) have demon- 
strated the influence of social approval 
and disapproval on the modification of 
verbal behavior, but they provide no in- 
formation about their effects on the un- 
derlying attitudes. The present study was 
designed to explore, in a controlled fash- 
ion, the effects on attitudes of reward 
and punishment of expressed opinions. 
Specifically, it was predicted that subjects 
(Ss) rewarded by group approval for ex- 
pressing opinions opposite from their ini- 
tial attitudes would show a change in the 
direction of the expressed opinions, while 
Ss punished by group disapproval for ex- 
pressing contrary opinions would not 
show such a change. This prediction im- 
plies that reward of a new behavior in- 
creases the relative strength of the under- 
lying predisposition, while punishment of 
a new behavior leads the S to revert to 
his formerly preferred response disposi- 
tion, 


Method 


All students in 29 general psychology 
discussion sections were administered free- 
response questions on mimeographed 
sheets to assess their attitudes toward 
three controversial issues: 

1. Universal military training. It has 
been proposed that all physically able 
males between the ages of 18 and 25 be 
required to spend two years in the 
armed forces so that they will be trained 
and ready for armed service in the event 
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of a national emergency. How do you 

feel about this proposal? 

2. Night hours for women students. 
Senior women at the University are not 
required to be back in their dorms or 
houses by any set time at night. Some 
students are requesting that all women 
be given the same freedom of hours. 
How do you feel about this? 

3. De-emphasis of football. It has 
been suggested that too much emphasis 
is placed on football at the University, 
in scholarships and special treatment for 
players. How do you feel about this? 
Each of the classes was assigned, in 

systematic fashion, one of the three issues 
for debate. The instructor read the class 
members’ opinions on the designated issue 
and selected from each class two which 
appeared definitely favorable and two 
definitely unfavorable. The four students 
were contacted outside of class and their 
cooperation requested in an “experiment 
to see how much they could affect the 
opinions of class members” by debating 
the particular issue; but each student 
would take the side opposite to his own 
opinion. Two pairs of debators were 
formed for each class, members with 
“pro” opinions taking the “con” side of 
the argument, and vice versa. It was ex- 
plained that, following the debate, the 
quality of performance wouid be assessed 
in two ways: first, by a class vote on which 
member of each pair did the better job; 
and second, by a retest of the class’ opin- 
ions on the issue, “to see in which direc- 
tion opinions are influenced.” 

The debators were counseled to avoid 
mentioning to anyone that they didn’t 
really believe what they were to say. (This 
was intended to help prevent the occur- 
rence of interfering responses (see 7) 
which might negate the effect of the ex- 
perimental stimulus.) In pairing the de- 


bators, an attempt was made to equate 
their verbal abilities, as evidenced in their 
written opinions, in order that a subse- 
quent false report of the vote would ap- 
pear valid. 

The debates were held two weeks after 
the original assessment of attitudes. One 
pair of opponents was called into the 
classroom, while the other pair waited in 
an adjoining room. The “pro” debator 
spoke first, for three minutes, followed by 
a three-minute presentation from the 
“con” debator. Then each had a two-min- 
ute rebuttal period, in reverse order. The 
first pair left the room, and the second 
pair of opponents entered for a similar 
performance. Then, with all four de- 
bators present, voting instructions were 
given to the class (“On the first ballot 
write which side—pro or con—did a bet- 
ter job on the first debate. On the second 
ballot write which side—pro or con—did a 
better job on the second debate’). 

The ballots were handed in, and the 
instructor made a pretense of counting 
them, while one of the students tallied 
votes (as read by the instructor) on the 
blackboard, under the name of each de- 
bator. It had been determined in advance 
for each pair of debators in all classes who 
would “win.” “Winners” and “losers” 
were assigned alternately through the pairs 
of debators, so that half the time the 
“pros” won, and half the time the “cons” 
won. 

The instructor then repeated the impli- 
cations of the vote, mentioning the names 
of the “winners” and “losers,” and ex- 
plained that the next step in the judg- 
ment would be to see how the class's 
attitudes had been affected. All class 
members were given sheets of paper on 
which were printed the statement of the 
issue that had been debated—exactly like 
the first opinion assessment, except that 
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only one issue appeared on the sheet. De- 
bators were also asked to write their pres- 
ent opinions, “to see if there was any 
change in them.” 

After the opinion retest forms were col- 
lected, the nature and purpose of the 
experiment were explained, the pre- and 
postopinions of the debators were read, 
and an attempt made to reduce the threat 
of the situation for the “losers” and for 
those debators whose opinions had osten- 
sibly shifted. 

The pre- and postopinions of the de- 
bators were subsequently typed on cards, 
after the deletion of certain passages that 
might indicate which were postopinions 
(such as “I still feel that .. .”). The 
cards were identified only by numbers, 
duplicated on the original opinion ques- 
tionnaires, and the numbers assigned in 
“random” fashion, so as to prevent con- 
tamination in coding. Opinions on the 
cards were coded on a seven-point scale: 
l—very pro; 2—pro; 3—pro, qualified; 4— 
neutral or balanced pro and con; 5—con, 
qualified; 6—con; 7—very con. Then, by 
reference to the original questionnaires, 
each card was identified as a pre- or post- 
opinion of a “winner” or “loser.” 

Of the 58 pairs of debators initially 
designated, only 36 finally produced com- 
plete data. Twenty-one pairs failed to 
debate, due either to absences or to re- 
scheduling of classes; the postopinion of 
one member of the final pair was not code- 
able. The 36 debates took place in 19 
different classes, with six different instruc- 
tors. From these classes a sample of 36 
students whose original opinions were 
definitely pro or con, but who did not 
debate, was selected as a control group- 
Their pre- and postopinions were similarly 
transferred to cards with random identifi- 
cation by numbers, and coded on the 
same seven-point scale. 
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Results 


It was predicted that debators who 
“won” would show an average change in 
the direction of their debate greater than 
the corresponding change shown by 
“losers” and greater than the average 
change of the control group. Data bearing 
on this prediction are presented in Table 
1. Winners changed an average of 1.25 
points (in the direction of debate) on the 
seven-point scale, while losers changed an 
average of 0.17 points in the opposite 
direction (more extreme than their origi- 
nal positions). The control group changed 
an average of 0.31 points toward the opin- 
ion opposite from their original one. 

The difference between mean changes 
of winners and losers is significant beyond 
the .001 level of confidence, and the dif- 
ference between winners and controls is 
significant beyond the .02 level of confi- 
dence. The difference between losers and 
controls is not significant. 

An analysis of mean changes for the 
three issues separately, and for original 
pros versus original cons showed no sig- 
nificant differences among these groups, 
so the prediction was confirmed regardless 
of the issue and regardless of which ex- 
treme opinion the debator started with. 
When the proportions of changers in the 
three groups are compared, results are 
consistent with those for mean changes. 
More winning individuals shifted toward 
the opposite opinion than either losers or 
controls. 


DISCUSSION 


The experiment was designed to give 
both winners and losers equivalent con- 
tact with arguments for the opposite side, 
and to give both the experience of verbal- 
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TABLE 1 
Changes of Winners, Losers and Controls from Pre- to Post-test 
(Positive sign indicates mean change in direction 
opposite to Ss’ original opinions) 
————— SSE 


WINNERS LOSERS CONTROLS 
(N = 36) (N = 36) (N= 36) 
Number of changers 
(either direction ) 24 16 18 
Number of changers 
(toward opp. direction ) 21 7 11 
Mean change +1.25 —0.17 +0.3 
SD of change 1.77 1.17 1.37 


eee 


Difference in mean changes: 
Winners vs. losers: t = 3.97; p < .001. 
Winners vs. controls: t = 2.49; p<.02. 
Losers vs. controls: t = —1.58; p > .10. 


From Scott: Attitude change through reward of verbal behavior. 


izing these arguments as if they were their 
own. What distinguished the two groups 
was the brief experience of either group 
approval or group disapproval for their 
performances. These performances in- 
volved principally the oral presentation of 
arguments—verbal behavior to which they 
were unaccustomed. The vote of “win” is 
presumed to have reinforced the verbal 
behavior and with it the accompanying 
implicit responses—attitudes and cogni- 
tive support for them. The vote of “lose” 
presumably weakened whatever response 
tendencies had been established by the 
overt behavior or by cognitive contact 
with the opposite side, so that Ss reverted 
to their pre-existing attitudes. 

If the opinion posttests be regarded as 
valid reflections of Ss’ attitudes following 
the experimental stimulus, then one may 
conclude that social reward for expressing 
a new opinion tends to reinforce the con- 
comitant attitudes, whereas social disap- 
proval of the new behavior tends to lead 
to nonreinforcement of the accompanying 


attitudes. It appears that, in the present 
experiment, the brief experience of reward 
or punishment was a significant factor in 
accounting for attitude change, rather 
than the more prolonged experience of 
cognitive contact with opposing argu- 
ments. 

This finding is, however, subject to at 
least two interpretations. It may be that 
reward of a new behavior was the crucial 
factor, while cognitive contact in and of 
itself had no effect. Or it may be that 
contact with opposing arguments pro- 
duced a change in attitude, which was 
then reinforced or extinguished depend- 
ing on whether the first overt expressions 
were rewarded or punished. Since Janis 
and King (6) showed that contact with 
the opposite side tended, by itself, to 
produce some change, the latter interpre- 
tation appears more plausible. In order to 
help determine the relative importance of 
these two influences—cognitive contact 
and reinforcement—in this situation, it 
would have been necessary to have some 
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Ss debate without a subsequent “winning” 
or “losing” experience. This experiment 
did not provide for such a condition. Re- 
gardless of whether one accepts a single- 
factor or a two-factor interpretation of the 
results, it appears that they speak clearly 
for the significance of reward in producing 
attitude change in this type of situation. 

It should be noted that very few of the 
changes in opinion were of a spectacular 


sort, (Only seven of the rewarded Ss re- 
versed the direction of their opinions; the 
other fourteen changers merely showed 
some weakening of their initial opinions, 
as cated by a shift along the seven- 
point scale toward the neutral position.) 
Although the experience of success or fail- 
ure was made as strong as possible under 
these restricted conditions, it was never- 
theless a brief and perhaps not too potent 
one, Between the announcement of the 
“class vote” and the posttest of opinion 
no more than five minutes elapsed. 

The degree to which the new opinions 
persisted was not assessed in this study. It 
is reasonable to suppose that effects of 
the experimental situation were transi- 
tory, since the Ss’ initial attitudes presum- 
ably found considerable social support in 
their current friendship groups. In order 
to produce enduring attitude changes, it 
would probably be necessary to so change 
the Ss’ social environments that the new 
behaviors would receive continued rein- 
forcement. But transitory or enduring, the 
principles of attitude change illustrated in 
this experiment would appear to be ap- 
plicable. 


SUMMARY 


An experiment in attitude change was 
suggested by Doob’s learning theory of 
attitude development. Seventy-two Ss 
were induced to engage in debates on 
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three different issues, taking sides oppo- 
site to those which they had indicated as 
their own in an opinion pretest. Half of 
the Ss were rewarded, in predetermined 
order, by a purported vote which pro- 
claimed them the better debators, while 
the other half were punished by presum- 
ably losing the debate. Posttests of Ss’ 
opinions showed a tendency of the “win- 
ners” to change their opinions in the 
direction of their debates, while the 
“losers” did not change significantly. A 
control group of nondebators likewise 
showed no significant change in opinions. 
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31. 
Attitudes Established by Classical Conditioning*' 


Arthur W. Staats and 
Carolyn K. Staats 


Osgood and Tannenbaum have stated, 
“., . The meaning of a concept is its 
location in a space defined by some num- 
ber of factors or dimensions, and attitude 
toward a concept is its projection onto 
one of these dimensions defined as ‘eval- 
uative’ ” (9, p. 42). Thus, attitudes evoked 
by concepts are considered part of the 
total meaning of the concepts. 

A number of psychologists, such as 
Cofer and Foley (1), Mowrer (5), and 
Osgood (6, 7), to mention a few, view 


* From A. W. Staats and C. K. Staats, 
Attitudes established by classical condition- 
ing, J. abnorm. soc. Psychol., 57, 37-40 
(1958). Reprinted by permission of the 
authors and the American Psychological 
Association. 


1 This article is part of a series of 
studies of language learning formulated by 
the first author as the principal investi- 
gator of a research project supported by 
the Office of Naval Research under Con- 
tract NONR-2305 (00) with Arizona 
State College at Tempe. 


meaning as a response—an implicit re- 
sponse with cue functions which may 
mediate other responses. A very similar 
analysis has been made of the concept of 
attitudes by Doob, who states, “ ‘An at- 
titude is an implicit response . . . which is 
considered socially significant in the indi- 
vidual’s society’ ” (2, p. 144). Doob fur- 
ther emphasizes the learned character of 
attitudes and states, “The learning proc- 
ess, therefore, is crucial to an understand- 
ing of the behavior of attitudes” (2, p. 
138). If attitudes are to be considered 
responses, then the learning process 
should be the same as for other responses. 
As an example, the principles of classical 
conditioning should apply to attitudes. 

The present authors (12), in three ex- 
periments, recently conditioned the evalu- 
ative, potency, and activity components of 
word meaning found by Osgood and Suci 
(8) to contiguously presented nonsense 
syllables. The results supported the con- 
ception that meaning is a response and, 
further, indicated that word meaning is 
composed of components which can be 
separately conditioned. 

The present study extends the original 
experiments by studying the formation of 
attitudes (evaluative meaning) to socially 
significant verbal stimuli through classical 
conditioning. The socially significant ver- 
bal stimuli were national names and 
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familiar masculine names. Both of these 
types of stimuli, unlike nonsense syllables, 
would be expected to evoke attitudinal 
responses on the basis of the pre-experi- 
mental experience of the Ss. Thus, the 
purpose of the present study is to test 
the hypothesis that attitudes already elic- 
ited by socially significant verbal stimuli 
can be changed through classical condi- 
tioning, using other words as uncondi- 
tioned stimuli. 


Method 
SuByECTS 


Ninety-three students in elementary 
psychology participated in the experi- 
ments as Ss to fulfill a course requirement. 


PROCEDURE 


The general procedure employed was 
the same as in the previous study of the 
authors (12). 


Experiment I 


The procedures were administered to 
the Ss in groups. There were two groups 
with one half of the Ss in each group. 
Two types of stimuli were used: national 
names which were presented by slide pro- 
jection on a screen (CS words) and words 
which were presented orally by the E (US 
words), with Ss required to repeat the 
word aloud immediately after E had pro- 
nounced it. Ostensibly, Ss’ task was to 
separately learn the verbal stimuli simul- 
taneously presented in the two different 
ways. 

Two tasks were first presented to train 
the Ss in the procedure and to orient 
them properly for the phase of the experi- 
ment where the hypotheses were tested. 
The first task was to learn five visually 
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presented national names, each shown 
four times, in random order. Ss’ learning 
was tested by recall. The second task was 
to learn 33 auditorily presented words. Ss 
repeated each word aloud after E. Ss were 
tested by presenting 12 pairs of words. 
One of each pair was a word that had just 
been presented, and Ss were to recognize 
which one. 

The Ss were then told that the primary 
purpose of the experiment was to study 
“how both of these types of learning take 
place together—the effect that one has 
upon the other, and so on.” Six new na- 
tional names were used for visual presen- 
tation: German, Swedish, Italian, French, 
Dutch, and Greek served as the CSs. 

These names were presented in random 
order, with exposures of five sec. Approxi- 
mately one sec. after the CS name ap- 
peared on the screen, E pronounced the 
US word with which it was paired. The 
intervals between exposures were less than 
one sec. Ss were told they could learn the 
visually presented names by just looking 
at them but that they should simultane- 
ously concentrate on pronouncing the 
auditorily presented words aloud and to 
themselves, since there would be many of 
these words, each presented only once. 

The names were each visually presented 
18 times in random order, though never 
more than twice in succession, so that no 
systematic associations were formed be- 
tween them. On each presentation, the 
CS name was paired with a different 
auditorily presented word, i.e., there were 
18 conditioning trials. CS names were 
never paired with US words more than 
once so that stable associations were not 
formed between them. Thus, 108 differ- 
ent US words were used. The CS names, 
Swedish and Dutch, were always paired 
with US words with evaluative meaning. 
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The other four CS names were paired 
with words which had no systematic 
meaning, e.g., chair, with, twelve. For 
Group 1, Dutch was paired with different 
words which had positive evaluative mean- 
ing, e.g., gift, sacred, happy; and Swedish 
was paired with words which had negative 
evaluative meaning, e.g., bitter, ugly, fail- 
ure? For Group 2, the order of Dutch 
and Swedish was reversed so that Dutch 
was paired with words with negative eval- 
uative meaning and Swedish with positive 
meaning words. 

When the conditioning phase was com- 


German 


The Ss were told how to mark the scale 
and to indicate at the bottom of the page 
whether or not the word was one that had 
been presented. 

The Ss were then tested on the audi- 
torily presented words. Finally, they were 
asked to write down anything they had 
thought about the experiment, especially 
the purpose of it, and so on, or anything 
they had thought of during the experi- 
ment. It was explained that this might 
have affected the way they had learned. 


Experiment II 


The procedure was exactly repeated 
with another group of Ss except for the 


2 The complete list of CS-US word pairs 
is not presented here, but it has been de- 
posited with the American Documentation 
Institute. Order Document No. 5463 from 
ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, 
Washington 25, D.C., remitting in ad- 
vance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to 
Chief, Photoduplication Service, Library 
of Congress. 


pleted, Ss were told that E first wished to 
find out how many of the visually pre- 
sented words they remembered. At the 
same time, they were told, it would be 
necessary to find out how they felt about 
the words since that might have affected 
how the words were learned. Each S was 
given a small booklet in which there were 
six pages. On each page was printed one 
of the six names and a semantic differen- 
tial scale. The scale was the seven-point 
scale of Osgood and Suci (8), with the 
continuum from pleasant to unpleasant. 
An example is as follows: 


half of the Ss were in Group 1 and half in 
Group 2. For Group 1, Tom was paired 
with positive evaluative words and Bill 
with negative words. For Group 2 this 
was reversed. The semantic differential 
booklet was also the same except for the 
CS names. 


Desicn 


The data for the two experiments were 
treated in the same manner. Three varia- 
bles were involved in the design: condi- 
tioned meaning (pleasant and unpleas- 
ant); CS names (Dutch and Swedish, or 
Tom and Bill); and groups (1 and 2). 
The scores on the semantic differential 
given to each of the two CS words were 
analyzed in a 2 x 2 latin square as de- 
scribed by Lindquist (4, p. 278) for his 
Type II design. 


Results 


The 17 Ss who indicated they were 
aware of either of the systematic name- 
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word relationships were excluded from the 
analysis. This was done to prevent the 
interpretation that the conditioning of 
attitudes depended upon awareness. In 
order to maintain a counter-balanced de- 
sign when these Ss were excluded, four Ss 
were randomly eliminated from the an- 
alysis. The resulting Ns were as follows: 
24 in Experiment I and 48 in Experiment 
II. 
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Table 1 presents the means and SDs of 
the meaning scores for Experiments I and 
II. The table itself is a representation of 
the 2 x 2 design for each experiment. The 
pleasant extreme of the evaluative scale 
was scored 1, the unpleasant 7. 

The analysis of the data for both experi- 
ments is presented in Table 2. The results 
of the analysis indicate that the condition- 
ing occurred in both cases. In Experiment 


TABLE 1 


Means and SDs of Conditioned Attitude Scores 
eels eee ss 


NAMES 
Dutch Swedish 

Experiment Group Mean SD Mean SD 
I 1 2.67 94 3.42 1.50 

2 2.67 1.31 1.83 90 

Tom Bill 

Experiment Group Mean SD Mean SD 
II 1 2.71 2.01 4.12 2.04 
2 3.42 2.55 1.79 1.07 


el 
Note, On the scales, pleasant is 1, unpleasant 7. 


From Staats and Staats: Attitudes established by classical conditioning. 


TABLE 2 
Summary of the Results of the Analysis of Variance for Each Experiment 
eee SSS SSS E 


EXP. I EXP. II 
Source df MS F df MS F 
Between Ss 
groups 1 7.52 4.36* 1 15.84 5.00* 
error 22 1.73 46 3.17 
Within 
conditioned attitude 1 7.52 bie 1 55.51 10.47** 
names 1 .02 01 1 .26 05 
residual 22 1.36 46 5.30 
Total 47 95 
hre huri a AN re 
* p <.05. 
p <01. 


From Staats and Staats: Attitudes established by classical conditioning. 
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I, the F for the conditioned attitudes was 
significant at better than the .05 level. In 
Experiment II, the F for the conditioned 
attitudes was significant at better than the 
.01 level. In both experiments the F for 
the groups variable was significant at the 
05 level. 


DISCUSSION 


It was possible to condition the attitude 
component of the total meaning re- 
sponses of US words to socially significant 
verbal stimuli, without Ss’ awareness. This 
conception is schematized in Fig. 1, and 
in so doing, the way the conditioning in 
this study was thought to have taken 
place is shown more specifically. The na- 
tional name Dutch, in this example, is 
presented prior to the word pretty. Pretty 
elicits a meaning response. This is sche- 
matized in the figure as two component 
responses; an evaluative response rpy (in 
this example, the words have a positive 
value), and the other distinctive responses 
that characterize the meaning of the word, 
Rp. The pairing of Dutch and pretty re- 
sults in associations between Dutch and 


Tpy, and Dutch and Rp. In the following 
presentations of Dutch and the words 
sweet and healthy, the association be- 
tween Dutch and rpy is further strength- 
ened. This is not the case with associations 
Rp, Rs, and Ry since they occur only once 
and are followed by other associations 
which are inhibitory. The direct associa- 
tions indicated in the figure between the 
name and the individual words would also 
in this way be inhibited. 

It was not thought that a rating re- 
sponse was conditioned in this procedure 
but rather an implicit attitudinal response 
which mediated the behavior of scoring 
the semantic differential scale. It is possi- 
ble, with this conception, to interpret two 
studies by Razran (10, 11) which concern 
the conditioning of ratings. Razran found 
that ratings of ethnically labeled pictures 
of girls and sociopolitical slogans could be 
changed by showing these stimuli while 
Ss were consuming a free lunch and, in 


FIG. 1. The conditioning of a positive 
attitude. The heaviness of line represents 
strength of association. From Staats and 
Staats: Attitudes established by classical 
conditioning. 


ATTITUDES ESTABLISHED BY CLASSICAL CONDITIONING 


the case of the slogans, while the Ss were 
presented with unpleasant olfactory stim- 
ulation. The change in ratings could be 
thought to be due to the conditioning of 
an implicit evaluative response, an atti- 
tude, to the CSs by means of the lunch 
or the unpleasant odors. That is, part of 
the total response elicited by the food, for 
example, was conditioned to the pictures 
or slogans and became the mediation 
process which in turn elicited the positive 
rating. 

It should be stated that the results of 
the present study do not show directly 
that Ss’ behavior to the object (eg., a 
person of Dutch nationality) has been 
changed. The results pertain to the Ss’ 
attitudinal response to the signs, the na- 
tional names themselves. However, Ka- 
pustnik (3) has demonstrated that a 
response generalized to an object when 
the response had previously been condi- 
tioned to the verbal sign of the object. 
Osgood states, 


The aggressive reactions associated with 
Nazi and Jap on a verbal level certainly 
transferred to the social objects represented 
under appropriate conditions. Similarly, 
prejudicial behaviors established while read- 
ing about a member of a social class can 
transfer to the class as a whole . . . (7, p. 
704). 


The results of this study have special 
relevance for an understanding of attitude 
formation and change by means of verbal 
communication, Using a conception of 
meaning as a mediating response, Mowrer 
(5) has suggested that a sentence is a con- 
ditioning device and that communication 
takes place when the meaning response 
which has been elicited by the predicate 
is conditioned to the subject of the sen- 
tence. The results of the present study 
and the previous one of the present au- 
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thors (12) substantiate Mowrer’s ap- 
proach by substantiating the basic theory 
that word meaning will indeed condition 
to contiguously presented verbal stimuli. 
In the present study, the meaning com- 
ponent was evaluative, or attitudinal, and 
the CSs were socially significant verbal 
stimuli. The results suggest, therefore, 
that attitude formation or change through 
communication takes place according to 
these principles of conditioning. As an 
example, the sentence, “Dutch people are 
honest,” would condition the positive at- 
titude elicited by “honest” to “Dutch”— 
and presumably to any person called 
“Dutch.” If, in an individual’s history, 
many words eliciting a positive attitude 
were paired with “Dutch,” then a very 
positive attitude toward this nationality 
would arise. 

The reason for the group differences in 
each of the experiments is not clear. These 
differences could have arisen because there 
were actual differences in the Ss compos- 
ing each group, or in some condition of 
the procedure occurring to one of the 
groups. Nothing the authors were aware 
of seem to indicate this as the explanation, 
and in the previous experiments of the 
authors (12) there were no group differ- 
ences. Since in a 2 x 2 latin square the 
interactions are entirely confounded with 
the main effects, the group differences 
could also have arisen as a result of the 
interaction of the other two main effects 
(ie, direction of conditioning and 
names). 


SUMMARY 


Two experiments were conducted to 
test the hypothesis that attitude responses 
elicited by a word can be conditioned to 
a contiguously presented socially signifi- 


cant verbal stimulus. A name (e.g, 
Dutch) was presented 18 times, each time 
paired with the auditory presentation of a 
different word. While these words were 
different, they all had an identical evalua- 
tive meaning component. In Experiment 
I, one national name was paired with posi- 
tive evaluative meaning and another was 
paired with negative evaluative meaning. 
In Experiment II, familiar masculine 
names were used. In each experiment 
there was significant evidence that mean- 
ing responses had been conditioned to 
the names without Ss’ awareness. 
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chapter VII 


Social Interaction, Attitude Function, 


Group Cohesiveness, and Social Power 


‘THERE HAVE BEEN A NUMBER Of learning analyses made of social interac- 
tion. Miller and Dollard (1941) suggested that imitation may be con- 
sidered in terms of learning principles. Within the framework of oper- 
ant conditioning principles Skinner (1957) has made an analysis of the 
interaction of speaker and listener in what could be considered a com- 
munication interaction. Keller and Schoenfeld (1950) have dealt similarly 
with such interactions. More recently, Adams and Romney have presented 
an analysis of authority in terms of operant conditioning principles, and 
this is the first article presented in this section. Although Adams and 
Romney’s formulation is in the context of authority relations, this may be 
considered in a more general framework as the paradigm for face-to-face 
social interaction. 

Abstracting from the formulation, social interaction can be considered in 
terms of the discriminative stimulus value (SP value) which one individual 
has for another, as well as his reinforcing value (St [or CS"] when condi- 
tioned, S® [or UCS"] when unconditioned). Because of our training, cer- 
tain people, including their physical attributes and various accoutrements 
and environmental contexts, come to control certain of our behaviors. In 
addition, because of the reinforcers they manipulate contingent upon our 
behavior, people also shape our behaviors in the process of social inter- 
action. We also do the same with respect to their behavior. 

Adams and Romney elaborate this in its necessary detail. However, with 
this abstraction as the basis, a number of other studies in the field of social 
psychology may be considered. First, for example, the experiment by 
Sidowski, Wyckoff, and Tabory isolates the effect of reinforcement in a 
laboratory situation. It is found that when an individual controls positive 
and negative reinforcers which he may (unknowingly) deliver contingent 


329 


330 Social Interaction 


upon another individual’s behavior, and vice versa, there is a tendency for 
each to shape the other to deliver only positive reinforcers. It seems, and 
perhaps this conclusion has more general validity, that behavior which is 
aversive to others results in, or is likely to result in, reciprocal behavior 
which is aversive—and this tends, albeit not precisely, to reduce the aversive 
behavior in both parties. It would also be expected that the converse would 
be true. The later analyses will suggest mechanisms for this effect. 

The study by Azrin and Lindsley indicates how the nature of the situa- 
tion in terms of its reinforcers and the “rules” by which they are delivered, 
as discussed in the previous chapter, may determine the nature of social 
interaction of two children. The behaviors involved may be considered to 
be cooperative, that is, behaving in concordance and sharing reinforcers. 
When the “rule” is such that only when each child shares the rein- 
forcers will either of them attain any reinforcement, sharing behavior 
results even when, because of the pre-experimental histories of the chil- 
dren, they do not commence the interaction by sharing. 

The experiment by Cohen may be considered to demonstrate in a 
laboratory situation the different S? effect that various people have for an 
individual with respect to leadership and following behavior. As Cohen 
points out, the effects of the other people on the individual’s behavior is 
a result of the pre-experimental history of the individual with respect to 
those people—presumably, it might be added, the experience that would 
establish them as S?’s for the type of behavior studied. In addition, 
Cohen’s results show the effects of the manipulation of reinforcement on 
the behavior. That is, although the individual’s behavior on entering the 
experimental situation is a function of his past experience with respect to 
the various people with whom he interacts, the experimenter can change 
the nature of the interaction by manipulation of the reinforcement con- 
tingencies in the social situation. 

At this juncture, another principle important to the understanding of 
human motivation and social interaction will be introduced. We have 
already discussed the fact that the nature of, and rules of application of, 
reinforcers are crucial in shaping human behavior. This is so because a 
reinforcer when it follows a behavior will increase the strength of the 
behavior or maintain it in good strength. 

In addition, however, the importance of reinforcing stimuli, especially 
those of a social nature (attitudinal stimuli) may be seen when it is 
realized that establishing or changing the reinforcement value of a stimu- 
lus will change the power of that stimulus to elicit or control behavior. It 
is this function of stimuli that is frequently referred to in accounts of 
human motivation in the various social and behavioral sciences—and that 
has not been recognized fully in experimental psychology. Thus, it has 
been said that in addition to their rewarding value motivational stimulus 
objects also direct or control the behavior of striving for those objects. It 
is, in part, because such stimuli do control “striving” behavior of various 
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kinds that human behavior has been called goal-directed. The observation 
that motivational stimuli elicit or control behavior can be accounted for 
within the laboratory-established principles of learning, as the following 
analysis will suggest. And two studies will be presented that support the 
analysis. 

To begin, when a stimulus object is a reinforcer for a child, it is very 
likely to become an S? that will control various responses whose result is 
obtaining the object. Let us say that the stimulus object is a reinforcer for 
the child but does not yet control any behavior. In this case, if the child 
makes responses that take him away from the object, he is not reinforced 
by obtaining the object. However, some responses, for example, crawling 
or creeping toward the object, will result in receiving the object, thus 
reinforcing that behavior in the presence of that stimulus object. This of 
course fits the principle for establishing a discriminative stimulus (S?) 
that controls a response. That is, when a response is reinforced in the 
presence of a stimulus, the stimulus will come to bring on or control the 
behavior. (A stimulus that is a CS” and an S? can be called a CSP.) 

All reinforcing stimulus objects have the power to reinforce responses 
that result in obtaining those objects, and thereby are likely to become 
Ss that control that type of behavior. Thus, in the child’s experience a 
wide variety of stimulus objects that are reinforcers will come to control 
responses that result in obtaining those objects. These responses will also 
be quite varied—crawling toward, walking toward, running toward, climb- 
ing over and around obstacles, reaching and grabbing for, fighting and 
struggling for, asking, begging, and crying for a reinforcer. Later on, even 
more complex behaviors will come under the control of the reinforcing 
stimuli—working for, wheedling for, arguing for, flattering for, being in- 
gratiating for, being respectful for, as well as competing for in various 
ways, acceptable and otherwise. 

Thus, a wide variety of reinforcing stimuli will come to control a wide 
variety of these behaviors, which can be called “striving” behaviors. It 
should be noted also that although a stimulus will tend to control a wide 
number of “striving” responses, the specific response that occurs will also 
be a function of other controlling stimuli that are present in the situation. 
Although a reinforcing stimulus may control walking for and asking for 
behavior, the latter will be more likely to occur when there is another 
person present. 

It would also be expected that the amount of reinforcement value of 
the stimulus as a variable would come to control variable strengths of these 
“striving” behaviors. For example, when the stimulus has much reinforce- 
ment value it will reinforce strongly the behavior that obtains it, and thus 
come to control strong behavior. When the reinforcer is weak it will only 
weakly control striving behavior. 

Now, as will be supported in the next two studies, it would be expected 
from the application of another learning principle, that any new reinforcing 
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stimulus that was introduced to an individual would immediately control 
his behavior in the ways just discussed. Even though he had never been 
trained to strive for this particular object it would control this type of 
behavior simply because it had reinforcing value—the striving behavior 
already learned would generalize to the new reinforcing stimulus. 

The critical principle here is mediated generalization as it has been de- 
scribed in several previously presented selections. In describing the prin- 
ciple in the present context, let us recall that reinforcing stimuli have a 
reinforcing property because they elicit a certain type of response—positive 
reinforcers elicit one type of response and negative reinforcers elicit another 
type of response. Unconditioned reinforcing stimuli, UCS”, elicit this re- 
sponse without training, conditioned reinforcing stimuli, CS", elicit a 
“reinforcing” response through respondent conditioning. It should also be 
indicated again that responses have stimulus characteristics, and thus “posi- 
tive reinforcing responses” would be expected to have different stimulus 
characteristics than “negative reinforcing responses.” 

With this as the basic theory, the way generalization of stimulus control 
(S? value) established with one reinforcing stimulus will occur to a new 
reinforcing stimulus can now be outlined. That is, although several rein- 
forcing objects may have very different stimulus characteristics otherwise— 
that is, different size, shape, color, texture, smell, and so on—they may still 
have a similar stimulus characteristic in that they all elicit a “positive rein- 
forcing response” with its special stimuli. This may be schematized as fol- 
lows: CSr+ » tt _ s for a positive reinforcing stimulus, and 
GS t=___s for a negative reinforcer. 

Now, whenever a reinforcing stimulus is involved in the process whereby 
it becomes capable, as an SP, of controlling striving responses (making it 
a CSP), the stimulus characteristic of the reinforcing response will also 
become capable of controlling these striving responses, thus becoming an 
S? also. This may be depicted as follows for positive reinforcers. 


CSE SD —> ioe s£ —> Regtriving” 


Thus, the stimulus of the positive reinforcing response actually becomes 
an SP for the striving response. When this has occurred, that striving re- 
sponse will now be controlled by any new positive reinforcing stimulus 
since the new positive reinforcing stimulus will also elicit the r+___s?, 
and this mechanism will control the striving response. 

With this analysis in mind, the next two studies may be more fully 
appreciated. The studies are examples in the area of social interaction of 
the formation (or change) of social reinforcers (attitudes) and the way in 
which this effects the power of those social stimuli to control the behavior 
of others. 

In the study by Lott and Lott it was found that when child A has been 
reinforced in the presence of child B, child A will later select child B as a 
companion. Now, the behavior of selecting child B, or otherwise “striving” 
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toward child B, was not reinforced in the presence of child B. The experi- 
mental conditions simply paired child B with positive reinforcement and 
would be expected to condition a positive reinforcing response (or atti- 
tude), an rt s?, to child B. However, as in the preceding analysis, 
since rts? would control a number of “striving” responses, including 
verbal responses of requesting child B’s company, the results that occurred 
would be expected. Thus, the concepts of group attitudes and group co- 
hesion can be related with an integrated set of learning principles. And the 
analysis of the manner in which the reinforcement value of a stimulus can 
control behavior striving toward that stimulus receives support from the 
results. 

The next study by Bandura and Ross extends this analysis and gives it 
further support. In this study a child experiences the pairing of one adult 
with positive reinforcers, presumably conditioning in the child a positive 
reinforcing response, r+ s?, to that adult. Later it is found that the 
child imitates this adult more than he does an adult who has not been 
paired with positive reinforcers. That is, the one adult, as he has become 
a stronger reinforcer, has also become a stronger S” for imitating or follow- 
ing behavior. This would be expected from the analysis. As the r+ s? 
is conditioned to the adult, all the “striving” responses controlled by the 
r+ — 9 will be controlled by that adult. 

Thus, Bandura’s and Ross’s results indicate that imitating or following 
behavior is at least in part under the control of the reinforcing value of 
stimulus objects or people as social stimuli. This opens the study of social 
power to the experimental methods and principles of learning. On the 
basis of these results it is suggested that a change in the reinforcing value 
of an individual will change his power as a stimulus in controlling other 
people’s behavior in various ways. An increase in the reinforcing value of 
an individual will increase verbal and motor approach or companionable 
responses, respectful responses, affectionate behavior, following behavior, 
smiling, pleasant conversation, sympathetic responses, and the like. 

It is important to indicate that there are two ways that the reinforcing 
value of a stimulus can be increased. Reinforcing value may be increased 
by various learning processes, as will be described. In addition, however, 
the reinforcing value of a stimulus for an individual can be increased by 
depriving the individual of that stimulus. Thus, both of these operations 
should also have the effect of increasing the S? value of the stimulus. So 
all of the previous discussion concerning the S? value of reinforcing stimuli 
should pertain to effects that can be obtained through deprivation opera- 
tions. As an example, it would be expected that the imitation behavior 
obtained by Bandura and Ross would have occurred more strongly if the 
child had first been deprived of people (social reinforcers) as in the study 
of Gewirtz and Baer in the second Chapter. 

(Conversely, the results of the alteration of reinforcement value obtained 
by Lott and Lott, and by Bandura, Ross, and Ross should also have im- 
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plications for the experimental situation of Gewirtz and Baer. In Gewirtz 
and Baer’s study, a marble-dropping response was strengthened by apply- 
ing social approval to that response. It would be expected that making a 
person a stronger reinforcer through any of the mechanisms described in 
the present article would also increase his ability to mold behavior by giving 
approval, in addition to increasing his ability to bring on already learned 
behaviors such as imitation. ) 

It also follows that the S? value of a reinforcing stimulus could be re- 
duced by reducing its reinforcing value. This could be done by satiation 
operations, or by extinguishing the reinforcement value of a conditioned 
reinforcer, plus the other ways described herein. 

All of the examples used in the above account have involved the way in 
which positive reinforcing responses (r+ s?) control a wide variety of 
striving behaviors. It should be recalled, however, that the principle would 
be expected to hold also with negative reinforcers. Negative reinforcers 
rather than controlling a class of striving responses will come to control the 
opposite, responses that carry one away from the stimulus object or that 
drive the stimulus object away. These responses, both verbal and motor, 
will include cruel behavior, derisive or insulting comments, obstructionistic 
behavior, antagonistic responses, oppositional voting, and the like. In addi- 
tion, servile, cringing, afraid behavior, and so on, may also be acquired 
under the control of the negative reinforcing response. An increase in the 
negative reinforcing value of an individual through conditioning would be 
expected to insure that these overt responses would be more strongly 
controlled. 

In the two articles that have been presented (by Lott and Lott as well as 
Bandura and Ross), the reinforcement value and hence S? value of a 
social stimulus was changed by pairing the stimulus with positive rein- 
forcing objects. It can be suggested that this is only one of several different 
ways that the reinforcement value of a social stimulus could be changed 
through conditioning. For example, the same process could be accom- 
plished via moving or still pictures. It would thus be expected, using the 
procedure of Bandura and Ross, that if an adult was shown to “possess” 
many reinforcers in a film, his own reinforcement value as a stimulus would 
be increased, and consequently his S? for controlling following behavior 
would also be increased. This suggests that reinforcement and S? value can 
be changed through pictorial mass communication media. 

In addition, it would also be expected that the change in the reinforce- 
ment value and S? value of a person could also be changed purely through 
the function of language. In Selection 21 it was suggested that when a 
stimulus object is paired with word stimuli that elicit evaluative meaning 
responses (making these words reinforcing stimuli) the object will also 
come to elicit those evaluative meaning responses, that is, will also come to 
be a reinforcer. Thus, as the experiment in the preceding chapter showed, 
if words like beauty, win, gift, sweet, honest, smart, tich, sacred, friend, 
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valuable, happy, pretty, healthy, success, love, and so on were paired with a 
person, that person would become a stronger positive reinforcer, and a 
stronger S? capable of controlling many “positive” verbal and motor be- 
haviors. 

It would not even be necessary that the individual himself be paired with 
the word reinforcers. The same end could be achieved by pairing his name 
with the word reinforcers, as shown by the study of Di Vesta and Stover 
described in Selection 21, as well as Lott’s study in the preceding chapter. 
It would also be possible to pair an individual’s picture with the reinforcing 
words and thus produce the conditioning and its effects. For these reasons, 
the change of reinforcer and S? value and the ways these influence group 
cohesiveness and other social interactions could be made via mass com- 
munication media—film, radio, television, newspapers, magazines, and 
books—as well as through face-to-face communication. 

It should be possible to demonstrate the validity of these implications 
and the basic analysis in systematic experimentation. For example, it 
should be possible to enhance the leadership (social power) of an indi- 
vidual in Cohen's experimental procedure by increasing that individual’s 
reinforcement value through direct or verbal conditioning of the various 
types mentioned. This could also be accomplished by “labelling” an indi- 
vidual with a name that has positive or negative reinforcement value, such 
as “doctor.” It should also be possible in these various additional ways to 
change imitational control using the Bandura and Ross experimental pro- 
cedures as well as the group cohesiveness of Lott and Lott. 

The learning analysis also appears to have other implications. For ex- 
ample, concerning group prejudice, if a group’s distinctive physical 
features, name, dress, language, or other behavior, elicits little positive 
reinforcing value, the members of the group will have little social con- 
trolling power. That is, members of the group will not be listened to, 
imitated, followed, chosen as a companion, and so on, or even hired, pro- 
moted, and so forth to the extent that members of groups will who have 
more reinforcement value. If the group, or its name, elicits negative rein- 
forcing responses its members will be more likely to be insulted, avoided, 
opposed, arrested, rejected, fired, and so on, and in extreme cases, killed, 
lynched, and fought against. Verbal passages, films, or direct experience 
that presents members of the group, or its name, in contiguity with nega- 
tive reinforcers would be expected to enhance the undesirable behaviors 
controlled by (made to) members of the group. 

Matters of concern in the field of propaganda and advertising can also 
be incorporated into this learning analysis. One of the common techniques 
of the political editorial, for example, is to present the name of a political 
figure in contiguity with positive reinforcing words when the writer favors 
the politician or with negative reinforcing words when the writer is op- 
posed. Each one of the pairings of name and reinforcing word may be 
considered to be a conditioning trial that changes the reinforcing value of 
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the political figure’s name and person. When that name or its owner ap- 
pears on later occasions, the individual who has been so conditioned, taking 
the negative case as an example, will speak against the political figure and 
his principles, vote against him, fight against him, and so on. 

Finally, even more far-reaching extensions of learning principles to social 
behavior have been suggested. Skinner (1953, 1961) has suggested that 
even the most complex aspects of human affairs may be understood in 
terms of reinforcement principles, for example, social institutions such as 
government, education, religion, and cultural change, albeit in very general 
terms. Based upon these considerations he has suggested that some cultural 
practices are more reinforcing than others and that cultural practices could 
be purposely designed to provide a more propitious environment for man. 

The present author (see Staats and Staats, 1963) has suggested several 
mechanisms of a learning nature that could result in social evolution or 
change. For example, it was suggested that the various activities we call 
science are the behaviors of men subject to the principles of conditioning. 
These behaviors were seen as emerging into a more dominant position in 
our society because they result in greater reinforcement than other com- 
peting behaviors. Scientific behavior has become more dominant because 
it results in avoiding aversive natural occurrences and obtaining positive 
reinforcers. The scientific behavior should consequently become more 
dominant in the society through several mechanisms. First, reinforcement 
will strengthen the behavior in the individual. In addition, however, others 
who are around this individual will experience positive reinforcement in his 
presence. This will give him greater social power and enable him to in- 
fluence the behavior of a larger number of people. It will also put him in a 
position within the society where he will influence a much larger num- 
ber of people through communication media, as occurs when the indi- 
vidual becomes a member of a university faculty. The individual whose 
behaviors do not result in positive reinforcement for himself and others 
will in competition find his influence weakening. In addition, social prac- 
tices or social systems that differ in the extent to which they result in rein- 
forcement (positive or negative), will control differing extents of “striving” 
behavior. Social practices or systems that result in stronger positive rein- 
forcers will control stronger supportive behaviors than a competitive 
practice or system that results in little positive reinforcement or much 
negative reinforcement. 

A full discussion of these matters is not possible herein. Perhaps the 
potential productivity of the approach has been suggested, however. Thus, 
the learning analysis, an integration of principles of operant and respond- 
ent conditioning, appears capable of extension to an understanding of 
evaluative word meaning, attitude formation and function, social inter- 
action, group cohesiveness and prejudice, individual social power, propa- 
ganda, and perhaps even such broad social phenomena as social change 
and the evolution of social practices. 
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32. 
A Functional Analysis of Authority*' 


]. Stacy Adams and 
A. Kimball Romney 


An important segment of social inter- 
action that requires systematic analysis is 
the behavioral control of one person over 
another: in other words, authority. The 
purpose of this paper is to analyze this 
type of interaction for the dyad, showing 
of what variables it is a function. 

Authority, as defined below, is seen as 
a special case of verbal behavior as ana- 
lyzed by Skinner (1957), and is conso- 
nant with his definition of the “mand.” 
Thus, the analysis of authority will make 
fundamental use of the concept of the 
reciprocal reinforcement of behavior. The 
general aim is to carry through an analysis 
of the dyadic situation, and simple exten- 


* From J. S. Adams and A. K. Romney, 
A functional analysis of authority, Psy- 
chol. Rev, 66, 234-251 (1959). Re- 
printed by permission of the authors and 
the American Psychological Association. 

1 This paper was written at the Interdis- 
ciplinary Program in the Behavioral Sci- 
ences at the University of New Mexico, 
Summer, 1958, sponsored by the Behavioral 
Sciences Division, Air Force Office of Sci- 
entific Research, under Contract AF 49 
(683)-33. We gratefully acknowledge 
their support. 


sions of it, that specifies the conditions 
that are relevant to the occurrence of 
“authority behavior” and the variables of 
which such behavior is a function. 

We begin with a definition of author- 
ity. A basic paradigm of an authority se- 
quence will then be given and the vari- 
ables of which such an authority sequence 
is a function will be discussed in detail. 
Finally, functional relationships between 
authority sequences will be analyzed. 


Definition of Authority 


We define authority as follows: Person 
A has authority over Person B, in a given 
situation, when a response of A, under 
the control of deprivation or aversive 
stimulation and specifying its own rein- 
forcement, is reinforced by B. 

This definition implies that authority is 
a social relation under the dual or recipro- 
cal control of both A and B. It is social in 
the sense that it requires behavior on the 
part of both A and B and that the be- 
havior of A constitutes a stimulus for B 
and vice versa. For the relation to be 
maintained, B’s behavior must be rein- 
forcing for A and A’s behavior must be 
reinforcing for B. As will be discussed 
later, the controlling relation of A over B 
may be enduring or temporary, and it may 
extend over a large or small range of B’s 
responses. 

The relation of authority is asymmetri- 
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cal in that A’s initial response (such as a 
command, request, suggestion, etc.) speci- 
fies its own reinforcement, whereas B’s 
does not. The reinforcement is provided 
by B’s response, if the response reduces 
the state of deprivation or withdraws aver- 
sive stimuli for A. For the maintenance of 
the relationship B’s response must be like- 
wise reinforced by A, but the reinforce- 
ment is not specified as in the case of A. 

The phrase, “in a given situation,” 
indicates that the authority relation is 
not assumed to be a general one between 
individuals regardless of time and place. 
Authority is learned in specific situations, 
although it may later be transferred to 
other situations by such processes as 
stimulus induction. The phrase also im- 
plies the reversibility of the relation from 
one situation to another. This reversibility 
may violate the usual definition of and 
feeling for “authority.” For example, one 
readily accepts the notion of a father’s 
authority over his son, while one would 
balk at a statement of a child’s “authority” 
over his father. Yet, precisely the same 
functional relationships may hold in both 
cases, as we shall demonstrate. It is, there- 
fore, both rigorous and useful to speak of 
a person’s having “authority” over another 
whenever the same relationships are 
found, even though this practice might do 
violence to everyday usage. 

The clause, “under the control of depri- 
vation or aversive stimulation,” indicates 
that it is not sufficient to know only the 
topography of the response of A, but that 
it is also necessary to specify the control- 
ling variables of the response of A. For 
example, if A says, “Water, please,” in 
the presence of B, we must know whether 
the controlling variable of that response 
is water deprivation or some other depri- 
vation, or whether it is aversive stimula- 
tion. 


When it is said that the response of A 
specifies its own reinforcement, we assume 
that there is “communication” between 
A and B. Not only does the presence of 
B, in part, set the occasion for the re- 
sponse of A, but the reinforcement of A’s 
response is contingent upon a response by 
B. Thus authority behavior is necessarily 
verbal behavior as defined by Skinner 
(1957), i.e., behavior the reinforcement of 
which is contingent upon stimulation of 
and response by another individual. The 
definitions of all other terms used in the 
analysis closely follow the behavioral, 
empirical definitions given by Verplanck 


(1957). 


Basic Paradigm of an Authority Sequence 


The central idea in authority relations 
is that of the reciprocal control and rein- 
forcement of behavior of two persons. 
Basically, the paradigm is that a response 
of one person, A, is reinforced by another 
person, B, and that, in turn, the reinfore- 
ing response of B is, itself, reinforced by 
A. Such an interaction will be called an 
authority sequence. An example is the 
situation in which Person A asks B for 
water and B complies by giving A water. 
Figure 1 gives an illustration of the proc- 
ess, The figure is divided into two parts, 
the top half representing stimuli and re- 
sponses directly related to Person A, while 
the lower half pertains to Person B. The 
interaction between A and B begins at the 
far left of the figure with A in a state of 
deprivation and in the presence of a dis- 
criminative stimulus, Sg and S,?. These 
stimuli set the occasion for the response 
Ray, “Give me water.” Sa is the stimulus, 
presumably physiological in the example, 
that results from water deprivation. Ss? 
is the discriminative stimulus resulting 
from B’s presence in A’s environment. 
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Sx? is a discriminative stimulus with re- 
spect to Ra; in this illustration by virtue 
of previous conditioning. The response, 
“Give me water,” would not occur unless 
A were thirsty; nor would it occur unless 
someone were present to give A water. In 
some sense, R4, is “appropriate” only in 
the presence of Sa and S,?, and these 
stimuli may therefore be viewed as “set 
ting the occasion for” and as having con- 
trol over R41. As will be seen, this control 
is not exclusive, however, for it is the 
reinforcement of Ra; in the presence of 
the two stimuli that is crucial for the 
demonstration of authority. 

Once the verbal command, “Give me 
water,” will be reinforced by giving water 
to B. Specifically, it is a discriminative 
stimulus, S41”, in that it sets the occasion 
for a response by B that is later reinforced. 
The major characteristic of Ra; is that it 
specifies how B can reinforce it. B is in 
fact “told” that the response, “Give me 
water,” has been emitted, it is a stimulus 
to A. When B gives water to A, his re- 
sponse, Rp, constitutes the reinforce- 
ment, Sp:* of response Raz. In addition, 
Rsı is also a discriminative stimulus, 
Sr:?, that sets the occasion for a further 
response by A. The response in this ex- 
ample is, “Thank you,” Rag. In tum, 
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Rap, a generalized reinforcer, constitutes a 
reinforcement of Rg. Although the re- 
ciprocal reinforcement of responses on 
that part of A and B is terminated arbi- 
trarily in the present example, Ry» itself 
would need to be reinforced by a further 
response of B, perhaps the verbal response, 
“You're welcome,” or a nod or smile. As 
the dots to the far right of Fig. 1 suggest, 
the sequence is theoretically infinite, 
though in practice it is finite. 

The use of only one discriminative 
stimulus (Ss?) is greatly simplifying a 
situation encountered in “real life.” The 
essence of the model is in no way affected 
by this simplification, however. Quite 
complex stimuli could be made discrimi- 
native—i.e., given “sign” status—in an ex- 
perimental situation, and an authority se- 
quence from “real life” could be repli- 
cated. 

In the illustrative sequence of behavior 
presented, it is important to note that if 
the sequence is interrupted at any point, 
predictable consequences follow. Assume, 
for example, that B does not give water to 


FIG. 1. Authority sequence with initial 
response under control of deprivation. 
From Adams and Romney: A functional 
analysis of authority. 
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A, after A has said, “Give me water.” This 
might be because R4, did not result in a 
discriminative stimulus for B, i.e., it had 
no “meaning” for B because of lack of 
previous learning. Or it may be that Ra; 
resulted in a discriminative stimulus that 
set the occasion for a response other than 
giving water, perhaps telling A to get his 
own water. Whatever the reason for not 
giving water to A, the consequence would 
be for Raı to undergo some extinction. 
Similarly, if the sequence were interrupted 
by A’s not emitting Ras, B’s response, 
Rai, giving water, would undergo some 
extinction, with the result that the proba- 
bility of Ra's being reinforced would be 
decreased. As before, the probability of 
A’s emitting R4; would then be smaller. 
In both instances where the sequence is 
interrupted, it is evident that A’s authority 
over B is decreased, at least in this particu- 
lar situation, It is interesting to note that 
in the first instance the decrease in A’s 
authority is primarily “because” of a fail- 
ure attributable to B. In the second in- 
stance, however, A’s authority is affected 
“because” of his failure to reinforce B’s 
response, Rgı. The use of “because” here 
is very loose, of course; no attribution of 
causality to A and B as persons is in- 
tended. Their responses are completely 
determined, except on their very first oc- 


currence, by their previous reinforcement 
history and by antecedent stimulus con- 
ditions. 

In Fig. 1, A’s initial response was partly 
under the control of deprivation. Instead 
it could have been under the partial con- 
trol of aversive stimulation. For example, 
B might have been making some disturb- 
ing noise and this aversive stimulus might 
have set the occasion for the response, 
“Keep quiet!” It is also true that B’s re- 
sponse, Ry, need not necessarily be rein- 
forced by the presentation of a positive 
reinforcing stimulus. It could have been 
reinforced by the withdrawal of an aver- 
sive stimulus or conditioned aversive 
stimulus. Figure 2 shows how aversive 
stimuli might exercise control in an au- 
thority interaction. 

An aversive noise stimulus, S,,2", and a 
discriminative stimulus, Sp?, set the occa- 
sion for the responses Ry; and Ra”, 
constituted by the verbal response, “Keep 
quiet!” and an implied threat carried by 
the accentuation and intonation of the 
verbal response. Thus B is presented with 
a discriminative verbal stimulus, S41”, 


FIG. 2. Authority sequence with initial 
response under control of aversive stimu- 
lation. From Adams and Romney: A 
functional analysis of authority. 
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and a conditioned aversive stimulus, 841%”. 
These stimuli set the occasion for stop- 
ping the noise, indicated in the figure as 
Rg:. This response consists of the with- 
drawal of the aversive noise stimulus, 
S,°", and constitutes a negative reinforcing 
stimulus for A, as well as a discriminative 
stimulus, Syi?, setting the occasion for a 
further response. The response, in this 
example, is the withdrawal of implicit 
threat and is labelled, —R4:ı%. This, in 
turn, is an appropriate negative reinforcing 
stimulus for B’s response, Ry. As in the 
previous example, the sequence of be- 
havior is stopped at this point. Thus, we 
have here an interesting case of escape 
conditioning, with an implied threat as a 
conditioned aversive stimulus, as well as 
one of avoidance conditioning with re- 
spect to the negative reinforcing stimulus 
inferred from the threat. 

In a manner analogous to that pre- 
sented earlier, interruption of the be- 
havioral sequence has implications for the 
authority A has over B. If B, for example, 
does not stop making noise (perhaps be- 
cause of the inadequate control of Sa.” 
and S4,%), A’s response, “Keep quiet!” 
will undergo some extinction and A’s au- 
thority over B will be weakened under the 
particular circumstances described. How- 
ever, B’s lack of compliance may of itself 
constitute additional aversive stimulation 
for A and thus set the occasion for a new 
response, perhaps, “If you don’t stop that 
noise, you'll suffer the consequences,” 
which may generate enough additional 
aversive stimulation for B to make him 
stop the noise. If this occurred, A would 
maintain his authority over B, though at 
some additional expense. A could, of 
course, alternatively “leave the field,” in 
which case there would be no question of 
authority over B. 

The sequence in Fig. 2 would also be 
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interrupted if A did not withdraw aversive 
stimulation after B had complied with his 
command. The consequence would be 
that Ry: would have less likelihood of 
occurring in the future, a fact which 
would tend to reduce the probability of 
occurrence of Ry; and Ry,” and, there- 
fore, would tend to reduce A’s authority 
over B in this illustrative situation. As 
was pointed out before, the resulting loss 
of control of A over B might set the occa- 
sion for new responses by A. 

In both the illustrations given thus far, 
certain assumptions have been made 
which need to be made explicit before the 
implications of the paradigm are further 
explored. Some of the assumptions con- 
cern the discriminative status of stimuli. 
For example, it is assumed in Fig. 1 that 
B is a discriminative stimulus (Sp?) 
setting the occasion for the response, 
“Give me water.” But by definition a 
discriminative stimulus is one in the pres- 
ence of which a response is reinforced and 
in the absence of which it is unreinforced. 
Since A’s response, Ri, is not reinforced 
until some time later, B cannot initially be 
a discriminative stimulus in the sense of 
setting the occasion for Ray. What is as- 
sumed, then, is some previous learning, 
i.e., some previous temporal contiguity of 
response (R41) and reinforcing stimulus 
(Sn1®) in the presence of B. The assump- 
tion is, however, only one of convenience, 
and what has been said applies to the free 
operant situation as well. If A had merely 
emitted spontaneously the response, “Give 
me water,” in the presence of B (and in 
the context of deprivation), and if B had 
responded appropriately to reinforce A’s 
response, the behavioral consequences 
would have been the same as previously 
discussed. The only difference is that B 
would have been a mere stimulus without 
discriminative properties. However, on 


Social Interaction 


342 


subsequent occasions B would have dis- 
criminative characteristics, assuming fur- 
ther that A’s responses had been unrein- 
forced on some occasion when B was 
absent. The same line of reasoning applies 
to other stimuli which appear as discrimi- 
native stimuli in the figures. 

Another assumption is that the recipro- 
cal reinforcement of behavior is a finite 
sequence. It was stated earlier that the 
reciprocal reinforcement sequence in the 
authority relation may be theoretically in- 
finite but that we assumed it was finite in 
practice. The assumption is difficult to 
substantiate even though everyday obser- 
vation suggests that persons in an authority 
relation do not reinforce each other’s re- 
sponses ad infinitum, There are, of course, 
cases where reinforcement continues for 
considerable lengths of time, for example 
the endless exchange of bows that occurs 
when a Westerner visits a Japanese home. 
Nevertheless, the fact is that in our cul- 
ture the interaction usually stops at ap- 
proximately the point indicated in Figs. 1 
and 2, and that extinction is not a conse- 
quence. The reason for this may be that 
terminating an interaction sequence at a 
certain point is of itself reinforcing in that 
it avoids aversive consequences which 
would be forthcoming were the sequence 
not terminated. Thus, for example, in our 
own culture there are conventions about 
the termination of an interaction sequence 
beyond which further responding is pun- 
ished by the use of conditioned aversive 
stimuli. As an illustration, it is commonly 
observed that after compliance with a re- 
quest, anything beyond a “Thank you” 
and “You're welcome” results in raised 
eyebrows, a sardonic smile, or a look of 
impatience, which may be discriminative 
stimuli for stopping the interaction. 
When the stimuli for stopping are not 
known to one of the parties in the inter- 


action (i.e, are not discriminative), re- 
sponding may continue for some time, as 
in the bowing example above. In some 
situations responding beyond a given 
point may have the aspect of impertinence 
and have appropriate aversive results, Al- 
ternatively, responding beyond a certain 
point is unreinforced by society, and an 
agreed-upon sequence of reciprocal rein- 
forcement becomes a discriminative stimu- 
lus for stopping to respond further. 


Controlling Variables 


Thus far it has been shown how an 
authority relation between two persons 
can evolve and either be maintained or 
be destroyed. The external events (in- 
dependent variables) of which responses 
(dependent variables) in an authority 
interaction are a function will now be 
discussed. This will be done by grouping 
variables into general classes and discuss- 
ing instances under class headings, The 
basic A-B interaction paradigm will be 
used throughout. 


REINFORCING STIMULUS VARIABLES 


Stimulus events that have the property 
of increasing the probability of recurrence 
of a preceding response are fundamental 
controlling variables. B’s giving water to 
A and A’s saying “Thank you” in Fig. 1 
are such events in that they increase the 
probability of A’s again asking B for water 
when he is later water-deprived, and of 
B’s giving A water, respectively, other 
variables remaining constant. In other 
words, certain responses such as “Give 
me water” have consequences which em- 
pitically increase their probability of re- 
currence and thus in part determine the 
authority A has over B. 

The importance of reinforcing stimuli 
is more pervasive than has been suggested 
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above, however. The discriminative char- 
acter of other stimuli is dependent upon 
their being paired with reinforcement. 
Thus, for example, in Fig. 1, B’s presence 
would not constitute a discriminative 
stimulus for A’s demanding water, unless 
it had been temporally contiguous with 
the reinforcement of A’s response. Nor, in 
Fig. 2, would A’s verbal command “Keep 
quiet!” be a discriminative stimulus for 
B’s stopping noisiness, unless stopping to 
make noise had been reinforced following 
the occurrence of the stimulus resulting 
from A’s response. It can therefore be seen 
that a reinforcing contingency is necessary 
before a stimulus can acquire discrimina- 
tive properties. This is, of course, not a 
sufficient characteristic: It is also required 
that the absence of a stimulus be asso- 
ciated with nonreinforcement before it 
can be a discriminative stimulus. For ex- 
ample, with respect to Fig. 1, it would be 
necessary that A’s response, “Give me 
water,” be unreinforced in the absence 
of B. 

The withholding of reinforcing stimuli 
following a response is the operation re- 
sulting in experimental extinction and, as 
an observable consequence, produces a 
decreased probability of response. Illustra- 
tions of this have been given previously. 

The general properties and the impor- 
tance of reinforcing stimuli having been 
pointed out, A and B as the agents or 
mediators of reinforcement must now be 
considered. 


A As A REINFORCER 


A can act as a direct mediator of rein- 
forcement or as a conditioned reinforcer. 
As a direct mediator he can both present 
positive reinforcers (or conditioned rein- 
forcers) and withdraw negative reinforcers 
(or conditioned negative reinforcers). A 


father can reinforce his child for obeying 
a command by giving it candy. The busi- 
ness executive can reinforce his secretary’s 
compliance with an order by withdrawing 
an implied threat, much as in the example 
of Fig. 2. In a similar fashion the traffic 
policeman reinforces stopping at his ges- 
tured command by lowering his arm and, 
hence, removing conditioned negative re- 
inforcers, 

It is evident that, as a direct mediator 
of reinforcement, A can exercise consider- 
able control over B’s behavior. But it is 
also true that, indirectly, he exercises con- 
trol over his own responses, for the proba- 
bility of recurrence of his own responses 
is in part a function of the extent to which 
he is successful in reinforcing B’s re- 
sponses. Other things being equal, then, 
A is in some sense the master of his own 
authority over B. This notion is not a new 
one, but in the present case it has the 
advantage of being systematically deriva- 
ble from the basic model. 

A further derivation is that A’s proba- 
bility of successfully developing or main- 
taining an authority relation over B will in 
part be a function of the amount and 
variety or range of reinforcers he has avail- 
able. The person who can mediate rein- 
forcements appropriate to several states of 
deprivation can exercise more authority 
than one who can, say, provide only food 
(e.g, a parent versus a neighbor). The 
person who has access to a large range of 
aversive stimuli can have more authority 
than one who has not (e.g, a company 
commander versus a corporal). From a 
similar consideration it also follows that 
the greater the amount and range of rein- 
forcers available to A, the greater the 
range of B’s responses he can control, 
other variables remaining constant. ‘Thus 
a parent can have wider authority than 
an older sister who can mete out limited 
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punishment only and who has no money 
for material rewards. 

As a conditioned reinforcer, either posi- 
tive or negative, A may also exercise con- 
trol over B’s behavior, as well as indirectly 
over his own. Before he can act as a con- 
ditioned reinforcer, however, it is neces- 
sary that he have acted on previous 
occasions as a direct mediator of reinforce- 
ment, or, at least, that he be similar to 
someone who acted as a reinforcer. The 
important thing to consider is that the 
mere presence of A can reinforce some of 
B’s responses, no direct reinforcement 
being given. For example, using the illus- 
tration of Fig. 1, it is possible for A to 
omit saying, “Thank you,” and for B’s re- 
sponse to remain at considerable strength, 
provided stimulus attributes of A have 
become conditioned or generalized rein- 
forcers by virtue of A’s having previously, 
and frequently, reinforced B’s responses. 
However, in order for the attributes of A 
to remain effective conditioned rein- 
forcers (and discriminative stimuli as 
well), it is necessary that on occasion A 
mediate direct reinforcement; otherwise 
B’s operant will undergo extinction. The 
same applies to A qua A as a negative 
conditioned reinforcer. 


B as A REINFORCER 


The distinguishing characteristic of B 
as a reinforcer is that his reinforcing re- 
sponse has no, or only a few, degrees of 
freedom, as contrasted with A as a rein- 
forcer. His reinforcing response is speci- 
fied by A, by definition. To be sure, the 
discrete topography of his response may 
vary, but its net effect on A is specified. 
Thus, for example, B may get and bring 
water to A in a variety of ways, but the 
giving of water is the essential property of 
the response that will reinforce A’s re- 
quest and, therefore, establish or maintain 
the authority relation. 


In a manner similar to A, B may also 
act as a conditioned reinforcer or negative 
conditioned reinforcer, in that the au- 
thority relation between the two will be 
maintained or strengthened. This pre- 
sumes, of course, that B, or someone 
similar to B, will have appropriately rein- 
forced A’s behavior in the past under 
similar circumstances. 


GENERALIZATION OF A AND B As 
CONDITIONED REINFORCERS 


It has been pointed out that A and B 
may exercise control over each other's be- 
havior, and thus maintain or strengthen 
an authority relation, in their capacities 
as conditioned reinforcers. It is also true 
that conditioned reinforcement may be 
effected by individuals other than A and 
B who have physical properties similar to 
A and B. Thus, an officer never before 
encountered may act as a conditioned re- 
inforcer of an enlisted man’s compliance 
with an order, by virtue of the fact that he 
has properties similar to those of other 
officers who have reinforced the same re- 
sponse. The dimensions of similarity in 
this example might be the uniform and 
emblems of office; or the relevant dimen- 
sion might be physical characteristics of 
verbal operants, e.g., “’ten shun!” Simi- 
larly, the authority of policemen is par- 
tially maintained, even though never be- 
fore seen personally, through stimulus 
induction. How often has one slowed 
down at the sight of an unknown police- 
man whose back was turned? 


DEPRIVATION AND AVERSIVE STIMULUS 
VARIABLES AFFECTING A 


As stated in the definition of authority, 
A’s initial response (order, command, re- 
quest, demand, etc.) is partially under the 
control of deprivation or aversive stimula- 
tion, other control being exercised by dis- 
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criminative stimuli (e.g., the presence of 
a B). This results from the fact that cer- 
tain responses of the human organism are 
typically followed by specific consequences 
under certain conditions agreed upon by 
the social community, and that when this 
occurs the probability of occurrence of 
these responses will be a function of the 
on or aversive stimulation paired 
the reinforcing consequences, Thus 
response, “Give me water,” has a 
r probability of occurrence under 
water deprivation than under satiation be- 
cause other organisms are more likely to 
have provided water when A emitted this 
response and was thirsty, It should be 
noted that deprivation and aversive stimu- 
lation do not necessarily exercise control 
over the response. The control results 
from the fact that other organisms are 
predisposed by “societal consensus,” so to 
speak, to respond in certain characteristic 
ways, This predisposition of other organ- 
isms is analogous to certain automatic 
consequences of the nonanimal environ- 
ment. For example, picking and eating an 
apple is automatically reinforcing when 
the organism is food-deprived, though not 
if he is satiated. Thus, food deprivation 
would come to control picking and eating 
an apple. A similar line of reasoning ap- 
plies to aversive stimulation, though in 
this case reinforcement consists in the 
withdrawal of an aversive stimulus. 

The relations holding between depriva- 
tion (or aversive stimulation), response 
topography of A, and reinforcing response 
by B are stated in idealized terms. This is 
especially true with regard to A’s response 
topography “specifying” its reinforcement. 
It is conceivable, for example, that the 
response, “Give me water,” specified not 
a state of water deprivation which could 
be reinforced by water but rather a de- 
mand for submissiveness on the part of 
B, the state of deprivation being for some- 
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thing other than water. In such a case the 
content of A’s response does not clearly 
specify the appropriate reinforcing stimu- 
lus—at least the words used do not clearly 
convey the state of A’s deprivation. How- 
ever, other aspects of the verbal response 
than the words may serve as appropriate 
discriminative stimuli for submissiveness 
(i.e., sheer compliance). The imperative 
mood of the response, for example, may 
serve this function. Whether it does this 
effectively on a particular occasion is, of 
course, a function of appropriate previous 
differential reinforcement. To put it 
somewhat loosely, it is a function of 
whether B has learned that use of the 
imperative mood is a “sign” for compli- 
ance regardless of the specific content of 
A’s response. 


DISCRIMINATIVE STIMULUS VARIABLES 


In the discussion of Figs. 1 and 2 the 
role of discriminative stimuli was made 
explicit. We wish to expand the discus- 
sion at this point and focus specifically on 
the discriminative stimuli that control A’s 
initial response. The discriminative stimu- 
lus characteristics of responses by A and B 
will be omitted, as they are evident. 

Two general groups of discriminative 
stimulus variables controlling A’s initial 
response may be considered, stimulus 
characteristics of B and situational stim- 
uli, excluding B. A general characteristic 
of B that may serve as a discriminative 
stimulus is his being an organism with 
the potentiality of responding. Without 
another person’s being present, a response 
by A cannot be reinforced, and A cannot 
exercise any authority. There are, how- 
ever, other relevant aspects of B. One is 
B as a particular individual, i.e., the stim- 
ulus characteristics of a B who has previ- 
ously reinforced A’s response, as opposed 
to a B who has not. A second is B as the 
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incumbent in a particular role, as an office 
boy or corporal, for example. In this 
instance characteristics of B serve as dis- 
criminative stimuli for a comparatively 
narrow range of responses by A. In other 
instances characteristics of B may set the 
occasion for one class of responses only; 
for example, the elevator boy is a discrimi- 
native stimulus for the response, “Take 
me to the sixth,” only. Thus we may think 
of B as having discriminative stimulus 
characteristics that exercise control over 
A’s responses with different degrees of 
specificity. The specificity of control exer- 
cised is a function of the extent of differ- 
ential reinforcement carried out in the 
presence of particular characteristics. 

The second group of discriminative 
stimulus variables are situational variables. 
They include virtually all relevant stimuli 
not directly pertaining to B. Some situa- 
tional variables are part of the purely physi- 
cal environment. Thus, the request, “Take 
me to the sixth,” has a low probability of 
being reinforced in the absence of an 
elevator. Similarly, “Give me water,” will 
usually have a low probability of occur- 
ting without a source of water in the 
immediate environment. However, in an 
instance of this sort, deprivation may be- 
come so severe that it exercises almost 
exclusive control. The “Water, water!” 
of the wounded soldier on the deserted 
battlefield is an example. Other situa- 
tional variables are of a more “social” 
character in that the presence of other 
persons, or of persons having particular 
types of interaction, has a controlling dis- 
criminative stimulus function. Certain 
kinds of commands or requests are not is- 
sued to one’s wife at home in the context 
of a cocktail party (and would go unre- 
inforced, if issued), though they are is- 
sued and reinforced when just family 


members are present. Orders may be suc- 
cessfully given to an employee at the of- 
fice, though not at the country club. 

Whether discriminative stimulus con- 
trol is exercised by B proper or by 
situational variables, it will be achieved 
only after differential reinforcement. The 
controlling stimulus variables may, of 
course, be of great complexity and require 
considerable training. For example, an au- 
thority response, R41, will be reinforced 
only if Stimuli I, J, . . . , or N are pres- 
ent, and if Stimuli B and C are present, 
and if Stimulus R is absent. The situation 
is analogous to those encountered in con- 
cept formation studies (e.g., Bruner, Good- 
now, & Austin, 1956). In the present in- 
stance a response is reinforced only in the 
presence of particular stimuli, whereas in 
concept formation studies a response is 
said to be “correct” in the presence of 
some stimulus combinations and “incor- 
rect” in the presence of other combina- 
tions. 

Since complex stimulus control of this 
type requires considerable training with 
differential reinforcement, it follows that 
in early stages of training control will be 
imperfect. Some variables, in the absence 
of others which are necessary for rein- 
forcement, will exercise some control over 
a response, even though it will not be 
reinforced. It is also possible that during 
the course of differential training “irrele- 
vant” variables would exercise some con- 
trol over an authority response. This 
inappropriate control of stimuli results 
when a response is reinforced in the pres- 
ence of both appropriate discriminative 
stimuli and irrelevant other stimuli. These 
stimuli then acquire some discriminative 
stimulus capacity. Their control is even- 
tually weakened and abolished during 
further differential training. 
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33: 
The Influence of Reinforcement and Punishment in a 
Minimal Social Situation*’ 


Joseph B. Sidowski, 
L. Benjamin Wyckoff, and 
Leon Tabory 


The study of conditioning in the labo- 
ratory, and the development of condition- 
ing theory (3, 5, 6), are justified in part 
by the hope that the principles derived 
will ultimately enhance our understand- 
ing of human behavior in complex situa- 
tions including social ones. The realiza- 
tion of such hopes is commonly relegated 
to some future time, and the path along 
which we expect to proceed is specified 
in the vaguest terms. In attempting to ap- 


* From J. B. Sidowski, L. B. Wyckoff, and 
L. Tabory, The influence of reinforcement 
and punishment in a minimal social situa- 
tion, J. abnorm. soc. Psychol., 52, 115- 
119 (1956). Reprinted by permission of 
the authors and the American Psychologi- 
cal Association. 

1 The writer wishes to thank Dr. David 
A. Grant for his helpful suggestions. 


proach this problem, several questions 
may be raised: (a) Is it possible to handle 
social behavior within the framework of 
current conditioning theory, and if not, 
at what point along a scale of increasing 
complexity is it necessary to introduce 
additional concepts? (b) What new con- 
ceptual and analytical tools are necessary 
to handle the additional complexity en- 
countered? 

In the present study we attempt to re- 
evaluate the essential features of a social 
situation as viewed entirely within the 
framework of conditioning theory, and to 
investigate the simplest situation that 
could be considered truly social within 
this framework. In this way, we hope to 
lay the groundwork for a systematic in- 
vestigation of social situations of increas- 
ing complexity, and to clarify methodo- 
logical and theoretical problems. Analysis 
of social behavior in these terms implies 
that no assumption whatever is to be 
made regarding such concepts as attitude, 
understanding, awareness, etc. If such fac- 
tors enter the picture at all, they are to be 
considered as manifestations of complex 
habits. Preferably, they will not be en- 
countered at all in the minimal social 
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situation, and in any event cannot be part 
of the definition of social behavior. 

When restrictions such as these are 
accepted, we arrive at a conception of 
social behavior that will, no doubt, seem 
strange to most social psychologists. How- 
ever, we gain the advantage of having a 
system that allows for a high level of 
objectivity in our definitions and princi- 
ples, and one that is readily related to the 
mass of careful investigations of condi- 
tioning (3, 4, 5, 6). In this analysis we 
will assume that the main factors con- 
trolling social behavior are reinforcement 
(reward) and punishment. Within this 
framework, the essential features of a so- 
cial situation may be expressed as follows: 
(a) Two or more Ss have at their disposal 
responses which result in reinforcing or 
punishing effects on other Ss. (b) The 
principal sources of reinforcement and 
punishment for any S depend on re- 
sponses made by other Ss. (c) The re- 
sponses controlling reinforcement and 
punishment are subject to learning 
through trial and error. We will assume 
that, whatever else may be involved, at 
least the above features are present in any 
social situation. At this point we may ask 
what learning would be predicted on the 
basis of these conditions alone, assuming 
only that the principles of conditioning 
theory are operating. In the present ex- 
periment an attempt was made to place 
Ss in a situation involving only these 
minimal features. 

Two Ss isolated from each other were 
provided with push buttons by means of 
which each could give the other reinforce- 
ment or punishment (score or shock). 
The effects of previous social learning 
were minimized, since Ss were not told 
(nor did they guess) that they were in a 
social situation at all. 

In this situation, if S makes a response, 


he does not “suffer the consequences” 
directly. An S can influence the reinforce- 
ing and punishing features of his environ- 
ment, only to the extent that his actions 
may change the behavior of the other S. 
Thus, if A makes a response which re- 
sults in a reinforcement for B, we may 
expect B to continue with, or to repeat, 
his immediately preceding behavior. Simi- 
larly, if A makes a response which results 
in a punishment for B, we may expect B 
to tend to discontinue his immediately 
preceding activity. In addition, when B 
receives punishment, we will also expect 
an increase in his over-all activity level. 
These changes in B’s behavior have a 
direct effect on the reinforcement and 
punishment being received by A. Thus A 
does receive some consequences of his re- 
sponses through an indirect but not en- 
tirely unlawful process. 

It is not intended that this situation 
should be directly comparable to familiar 
everyday encounters. We generally enter 
social situations already equipped with a 
massive amount of prior learning relating 
to the effects of our behavior on others. 
For example, we have stylized ways of 
indicating approval or disapproval that 
are in effect methods of reinforcing or 
punishing others, On the other hand, in 
many situations, the responses we have 
learned are no longer appropriate. For 
example, an adult who has had little ex- 
perience with children may find that his 
habitual ways of expressing approval and 
disapproval are completely ineffective 
when he first begins to interact with a 
child. As he gains experience he learns 
new responses. Other illustrations could 
be cited. One occasionally encounters 
adults who react negatively to conven- 
tional reinforcements or punishments. 
The process through which this learning 
and relearning takes place will be central 
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to any extension of conditioning theory 
into the realm of social behavior. We 
may ask, is face-to-face contact and 
“understanding” of the relationship be- 
tween Ss necessary for this learning or 
would such learning occur simply as a re- 
sult of the operation of reinforcement 
and punishment? It is questions such as 
these which we hope to answer through 
the present research program. The first 
step in this program is an investigation 
of behavior in the minimal situation. 

he experiment. As indicated above, 
two Ss, isolated from each other, were 
given the opportunity to make responses 
which resulted in reinforcement or pun- 
ishment (score or shock) for the other S. 
The general objective of the experiment 
was to discover what the course of learn- 
ing would be under these conditions, It 
seemed likely that one of the most im- 
portant parameters which would affect 
performance would be the magnitude of 
punishment used. Thus, two widely sepa- 
rated levels of shock were used for differ- 
ent groups of Ss. 


Ga 
i 


Method 


SuBJECTS 


The Ss were 40 members of elementary 
psychology courses at the University of 
Wisconsin who received class points for 
participating. 


APPARATUS 


The two experimental rooms were each 
equipped with a control panel which pro- 
vided two push buttons, an electrically 
operated counter, and a pair of electrodes. 
The right and left buttons in Room 1 con- 
trolled the counter and shock circuit in 
Room 2, and vice versa. Thus, pressing 
the right-hand button in Room 1 reg- 
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istered one point on the counter in Room 
2, while pressing the left-hand button in 
Room 1 delivered an electric shock to the 
electrodes in Room 2. Similarly the but- 
tons in Room 2 controlled the counter 
and shock in Room 1, except that the 
right and left buttons had the opposite 
effect. A small red light also blinked each 
time the counter was activated, and a 
white light served as a signal that the 
experiment had begun. The white light 
remained on until the session ended. The 
E’s control board contained counters 
which indicated the number of times that 
each of the four buttons had been 
pressed. 

An electronic circuit provided for regu- 
lation of the shock current and automatic 
compensation for changes in S’s resist- 
ance. Separate controls were available for 
each of the two Ss. 


PROCEDURE 


The 40 Ss, 20 pairs, were randomly as- 
signed to two groups of 10 pairs each. The 
Strong-Shock group received shock cur- 
rent equal to 200 per cent of their absolute 
threshold, while the Weak-Shock group 
received 110 per cent of the threshold 
reading. Preliminary tests indicated that 
the absolute threshold was more reliable 
and more clearly defined than a “pain” 
threshold, so this measure was used as a 
basis for shock levels. The current used for 
the Strong-Shock group had a mean of .12 
ma. and a standard deviation of .05, while 
the current used for the Weak-Shock 
group had a mean of .12 ma. and an SD 
of .07. 

Although two Ss served during each ex- 
perimental session, each S was led to be- 
lieve that he was the only S serving in the 
experiment. At no time during or after the 
session were the Ss given any indication 
that another S had served in the experi- 
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ment. Any questions concerning the cur- 
rent were ignored; however, each S was 
offered the opportunity to withdraw from 
the experiment before the session began. 
None of the Ss withdrew. 

After the threshold readings were com- 
pleted, S was taken to one of the two 
experimental rooms where he was seated 
before the S control board. Electrodes 
were attached to the first two fingers of his 
left hand. Instructions were then read to 
S, after which he was told to relax for a 
few minutes while the apparatus warmed 
up. During this time, E brought the sec- 
ond S before the E panel and went 
through the same procedure. The second 
S was taken to Room 2 and seated before 
the second control board. All Ss were 
given the following instructions: 

“When the white light goes on the ex- 
periment begins. The experiment is in 
progress as long as the white light stays on. 
You can press either of these buttons in 
any manner that you wish, and as fre- 
quently as you wish. Do not attempt to 
press both buttons at the same time and 
use only your right hand for pressing. You 
are to keep your left hand on the table. Do 
not hold a button down, but just press 
and release it. The object of the experi- 
ment is to make as many points as you 
can. Your point score will appear on this 
counter. The red light will blink and the 
counter will turn each time that you score 
a point. When the white light goes off, it 
is a signal that the experiment has ended. 
Remain seated until E comes into the 
room. Remember, you are to try to make 
as high a score as you can in any manner 
that you can.” 

During the experiment, the four scores, 
a shock and a point score for each of the 
two Ss, were recorded by E every 30 sec. 
over a period of 25 continuous minutes. 
This gave a record of 50 scores for each 


button on the two S control boards. 

At the conclusion of the experimental 
session, a series of questions was asked in 
order to determine whether or not any of 
the Ss were aware of the presence of 
another S in the experiment. 
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FIG. 1. Mean number of responses on the 
shock and score buttons by the strong- 
shock and weak-shock groups. From 
Sidowski, Wyckoff, and Tabory: The in- 
fluence of reinforcement and punishment 
in a minimal social situation. 


Results 


In the initial analysis, scores over 5 min- 
ute intervals were tabulated for “score” 
and “shock” responses for each of the 
two groups. These data are presented 
graphically in Fig. 1. An Alexander trend 
test (1) was carried out on the data and 
the F was found to be significant beyond 
the .05 level of confidence. Duncan’s test 
(2) for differences between ranked treat- 
ments was carried out on the ranked 
means (presented in Table 1) of the four 
button responses. The differences betwen 
all ranked means were significant well be- 
yond the .05 level of confidence (an ex- 
ception was the nonsignificant difference 
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TABLE 1 
Ranked Means for the Four-Button Responses 


RANKS MEANS 
Strong-shock button 397.85 
Weak-shock button 719.95 
Weak score button 786.75 
Strong score button 1,288.65 


From Sidowski, Wyckoff, and Tabory: 
The influence of reinforcement and 
punishment in a minimal social situa- 
tion, 


between the Weak-Shock—Weak-score 
means). In addition a ratio for each 5- 
minute interval was computed to give the 
proportion of the total responses which 
were “score” responses. These data are 
presented in Fig. 2. An Alexander trend 
test showed an F significant beyond the 
.05 level of confidence. 

These tests showed that the Strong- 
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FIG. 2. Proportion of the total number of 
responses which were correct responses 
(score responses) during the 25-min. ex- 
perimental session. From Sidowski, Wyck- 
off, and Tabory: The influence of rein- 
forcement and punishment in a minimal 
social situation. 


Shock group ‘yielded significantly more 
“score” than “shock” responses, while no 
such difference for the Weak-Shock 
group was found. The tests did not indi- 
cate that the slope of the curves, which 
would have reflected gradual improve- 
ment, was significant. Inspection of the 
curves suggested that our failure to show 
significant slopes might have been due to 
the fact that much of the learning had 
occurred within the first five minutes. 
Therefore, the data for the first five min- 
utes were divided into l-min. intervals 
and analyzed. These data are presented in 
Fig. 3. An Alexander trend analysis 
showed a significant difference between 
group slopes beyond the .05 level of con- 
fidence. This confirms our observation 
that learning took place within the first 
five minutes. 

As a result of the preceding analyses, 
the major fact to be noted is that learning 
did occur in the Strong-Shock group, 
whereas no evidence of learning was ob- 
tained in the Weak-Shock group. 
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FIG. 3. Proportion of the total number of 
responses which were correct (score re- 
sponses) during the first 5 minutes. From 
Sidowski, Wyckoff, and Tabory: The in- 
fluence of reinforcement and punishment 
in a minimal social situation. 
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Responses to the questions at the end 
of the experiment indicated that none of 
the Ss were aware that a second S was 
involved. 


DISCUSSION 


Two major questions may be raised re- 
garding the experimental findings: (a) 
Why did learning appear in the Strong- 
Shock group but not in the Weak-Shock 
group? (b) Why did learning occur at all 
under the conditions of this experiment? 

In order to answer these two questions 
it is necessary to examine some of the se- 
quences of responses which may have 
occurred during the course of the ex- 
periment. Examination of all possible 
sequences of events that might occur in 
the two groups becomes too cumbersome 
for our present purposes. However, it will 
be of interest to consider a few examples 
of possible beginning sequences and pos- 
sible end states. Generally, we might as- 
sume random behavior by both Ss at the 
beginning of the experimental session. For 
example, let us suppose that each S made 
a response that shocked the other. It is 
not unlikely that this event might occur 
by accident early in the session. However, 
it is clear that some shift away from this 
behavior would soon appear since neither 
S is receiving reinforcement and both are 
being punished. This shift would prob- 
ably occur sooner under conditions of 
Strong Shock. The Ss might shift at the 
same time, or one might shift sooner than 
the other, resulting in at least two possible 
new patterns. If both shifted to the rein- 
forcement button at the same time, both 
would now receive reinforcement and we 
would expect a tendency for this pattern 
to continue. (In fact, the same prediction 
would be made if Ss commenced to rein- 


force each other at any time.) This pat- 
tern is perhaps the most obvious “self- 
sustaining” pattern which might emerge, 
and thus is one of the possible end states 
which might prevail. On the other hand, 
suppose that one S shifted to the rein- 
forcement button before the other, or 
that, at any time, one S pressed the rein- 
forcement button while the other pressed 
the shock button. The S who is pressing 
the reinforcement button should tend to 
shift to the shock button, with the result 
of reversion to the condition of both 
shocking each other. Since both of these 
patterns are “unstable,” we might obtain 
a continual oscillation between the two 
states, with one S’ and then the other 
shifting temporarily to the reinforcement 
button. This oscillation itself would form 
a new pattern which could be stable un- 
der certain conditions, particularly if the 
magnitude of the shock were relatively 
small. If this magnitude were small 
enough, the intermittent reinforcement 
obtained by both Ss might sustain the 
over-all pattern. This oscillatory pattern 
thus represents another possible end state, 
one that would be most likely to occur 
under conditions of Weak Shock. Under 
conditions of Strong Shock, we might ex- 
pect that the intermittent reinforcement 
obtained by both Ss would not sustain 
the over-all pattern of oscillation because 
of the punishing effects of the shock. Of 
course, many other sequences of responses 
could occur during the session, but it ap- 
pears that most of these would be un- 
stable. 

Although the above considerations are 
not complete, they suggest a possible ex- 
planation for the occurrence of learning 
in the present experiment and the differ- 
ential effect of the two levels of shock. It 
is suggested that under conditions of 
Strong Shock, the most probable stable 
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pattern (end state) was that of both Ss 
reinforcing each other. Thus, Ss would 
end to shift among patterns until they 
nit on this solution. (Some Ss could be 
expected to return to earlier responses, 
such as pressing the shock button from 
time to time due to the intermittent rein- 
orcement which may have occurred early 
in the session following this type of re- 
sponse.) Under conditions of Weak 
Shock, the pattern of oscillation between 
he buttons was presumably the most 
probable stable state since any of several 
initial sequences could lead into this pat- 
tern. It was not possible to analyze the 
sequential patterns in the present experi- 
ment, so further experimentation would 
be necessary to test these interpretations. 

Within the framework of the present 
experiment, we can conclude that learn- 
ing was demonstrated in a minimal social 
situation where: (a) the effects of previ- 
ous social learning had been minimized, 
and (b) reinforcement and punishment 
were the only observable factors influenc- 
ing the behavior of the Ss. 


SUMMARY 


The present experiment investigates the 
influence of reinforcement and punish- 
ment in a minimal social situation. Two 
Ss, isolated from each other, were pro- 
vided with two push buttons by means of 
which each could give the other a shock 
or score. The effects of previous social 
learning were minimized since Ss were 
unaware of the fact that they were in a 
social situation at all. 
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The Ss were divided into a Weak Shock 
and a Strong Shock group. All Ss were 
merely told that they could press the two 
buttons in any manner that they pleased 
(no information was given concerning the 
purpose of the buttons). Each S was also 
told that he was to make as many points 
as possible. His score was indicated on a 
counter which was mounted in front of S. 

It was found that the proportion of the 
total number of responses (both score and 
shock) that were correct (score re- 
sponses) was significantly higher for the 
Strong-Shock group. Learning occurred in 
the Strong-Shock group within the first 5 
minutes of the 25-minute experimental 
session. Learning was not, however, evi- 
dent in the Weak-Shock group. 

Principles of reinforcement were used 
to interpret the results. 
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34, 
The Reinforcement of Cooperation 


Between Children** 


Nathan H. Azrin and 
Ogden R. Lindsley 


Most methods for the development and 
experimental analysis of cooperation be- 
tween humans require specific instruc- 
tions concerning the cooperative relation- 
ship between the individual responses. 
Peters and Murphree have developed one 
of the most recent of these methods (1). 
Skinner has suggested (2), and shown 
with lower organisms (3), that coopera- 
tion between individuals can be devel- 
oped, maintained, and eliminated solely 
by manipulating the contingency between 
reinforcing stimuli and the cooperative 
response. 

The advantages of eliminating instruc- 
tions concerning cooperation are that 
(a) the initial acquisition of cooperation 
can be studied, (b) subjects (Ss) that 


* From N. H. Azrin, and O. R. Lindsley, 
The reinforcement of cooperation between 
children, J. abnorm. soc. Psychol., 52, 
100-102 (1956). Reprinted by permission 
of the authors and the American Psycho- 
logical Association. 

1 This paper was read at a meeting of 
the Eastern Psychological Association on 
April 10, 1954, New York City. 


learn by demonstration and instruction 
with difficulty (i.e., infants, certain classes 
of psychotics, and lower organisms) can 
be studied, and (c) no problems involv- 
ing the effects of instructions upon the 
behavior of the Ss are involved. 

Some more general advantages of oper- 
ant conditioning techniques are (a) a 
more continuous record of the coopera- 
tive process is obtained, (b) extraneous 
environmental variables are minimized, 
and (c) relatively long periods of experi- 
mental observation are possible. 


Problem 


Can cooperation between children be 
developed, maintained, and eliminated 
solely by the presentation or nonpresenta- 
tion of a single reinforcing stimulus, avail- 
able to each member of the cooperative 
team, following each cooperative response? 


COOPERATIVE TEAMS 


Twenty children, seven to twelve years 
of age, were formed into ten cooperative 
teams of two children. The children in 
each team were matched as to age and 
sex. Seven teams were boys and three were 
girls. Selection was made via the request, 


2 We wish to thank the Harriet Tubman 
House and the South Bay Union of 
Boston, Mass., for providing the subjects 
and the use of their facilities. 


THE REINFORCEMENT OF COOPERATION BETWEEN CHILDREN 


“Who wants to play a game?” The first 
two volunteers of the same age and sex 
were chosen for each team. The age given 
by the children was verified against avail- 
able community center records. No infor- 
mation concerning the game was given 
during the selection. No teams were re- 
jected. 


COOPERATIVE RESPONSE 


Cooperation was assured by designing 
an apparatus that (a) could not be op- 
erated by one individual alone (assuring 
group behavior), and (b) demanded that 
one individual respond to the behavior of 
the other individual in order to produce 
reinforcement (assuring cooperation). 


PROCEDURE 


The two children of each cooperative 
team were placed at opposite sides of a 
table with three holes and a stylus in front 
of each child (see Fig. 1). A wire screen 
down the center of the table prevented 
each child from manipulating the other 
child’s stylus, which was on the other side 
of the table. 

The following instructions were given: 
“This is a game. You can play the game 
any way you want to or do anything else 
that you want to do. This is how the game 
works: Put both sticks (styli) into all 
three of the holes.” (This sentence was 
repeated until both styli had been placed 
in the three available holes.) “While you 
are in this room some of these” (the 
experimenter (E) held out several jelly 
beans) “will drop into this cup. You can 
eat them here if you want to or you can 
take them home with you.” The instruc- 
tions were then repeated without reply to 
any questions, after which E said: “I am 
leaving the room now; you can play any 
game that you want to while I am gone.” 
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FIG. 1. Apparatus used for the reinforce- 
ment of cooperation between children. 
From Azrin and Lindsley: The reinforce- 
ment of cooperation between children, 


Then E left the room until the end of the 
experimental session. 

If the styli were placed in opposite holes 
within 0.04 seconds of each other (a co- 
operative response), a red light flashed on 
the table (conditioned reinforcing stimu- 
lus) and a single jelly bean (reinforcing 
stimulus) fell into the cup that was acces- 
sible to both children.? Cooperative re- 
sponses were recorded on counters and a 
cumulative response recorder in an adjoin- 
ing room. 


EXPERIMENTAL DESIGN 


Each team was studied for one continu- 
ous experimental session divided into the 
following three consecutive periods with- 
out experimental interruption: 


1. First reinforcement period 


Every cooperative response was rein- 
forced for over 15 min. If the rate of re- 


Ee 

3 Skinner (3) presented two reinforcing 
stimuli (one to each pigeon) following 
each cooperative response. 
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sponse was not steady at this time, the 
reinforcement was continued until five 
minutes passed with no noticeable change 
in the rate of cooperation. 


2. Extinction period 


The cooperative responses were not re- 
inforced for a period of at least 15 minutes 
and until a steady rate of response for at 
least five minutes was observed. 


3. Second reinforcement period 


The cooperative responses were again 
reinforced until at least three minutes of 
a stable rate occurred. This was done to 
determine whether a reduction in rate 
during the extinction period was due to 
extinction, satiation, or fatigue. 


Results 


All teams learned to cooperate without 
specific instructions in the first 10 min. of 
experimentation. Observation through a 
one-way vision screen disclosed that 
leader-follower relationships were devel- 
oped and maintained in most cases. Al- 
most immediately eight teams divided the 
candy in some manner. With two teams, 
one member at first took all the candy un- 
til the other member refused to cooperate. 
When verbal agreement was reached in 
these two teams, the members then co- 
operated and divided the candy. Most 
vocalization occurred during the initial 
acquisition period and throughout the 
extinction period. This vocalization was 
correlated with a higher variability in rate 
during these periods. (See below.) 

Figure 2 contains cumulative records 
of the cooperative responses of the three 
teams with the highest, the median, and 
the lowest number of cooperative re- 


sponses for the experimental session. 
These curves show a large difference in 
the rate of acquisition of cooperation. 
One team took almost 10 minutes to 
acquire a high cooperative response rate. 
Stable rates of cooperation can be ob- 
served during the latter parts of the first 
reinforcement period. The gradual, rather 
than immediate, decline in cooperation 
during extinction suggests an orderly ex- 
tinction of cooperative behavior as is 
found with individual extinction curves. 
In all cases the variability of rate was 
greater during extinction than during re- 
inforcement. Skinner has found this in- 
creased variability in rate during extinction 
with lower organisms and has described it 
as emotional behavior (2, p. 69). The 
high rate of response following the first 
reinforcement of the second reinforce- 
ment period shows that reacquisition is 
almost immediate. 

Table 1 contains a quantification of the 
records for statistical analysis. The median 
and range of the number of cooperative 
responses per minute for all 10 teams dur- 
ing the critical periods of the experiment 
are given. The number of cooperative re- 
sponses per minute for the first three min- 
utes of the first reinforcement period was 
significantly lower than the rate during 
the last three minutes of the first rein- 
forcement period (p < .02).* This shows 
that the rate of cooperation was signifi- 
cantly lower during initial acquisition 
than during maintenance of cooperation. 
The number of cooperative responses per 
minute during the last three minutes of 
extinction was significantly lower than the 
rate during the last three minutes of the 


4 Wilcoxon's nonparametric T for paired 
associates was used in all statistical treat- 
ments (4). 
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first reinforcement period (p < .001). 
This shows that the removal of reinforce- 
ment during extinction significantly low- 
ered the rate of cooperation between these 
children. 

The number of cooperative responses 
per minute during the last three minutes 
of the second reinforcement period was 
significantly above the rate during the last 
three minutes of the extinction period 
(p <.001). This shows that the rate of 
cooperation was significantly increased 
during the second reinforcement period 


FIG. 2. Cumulative response records for 
the teams with the highest, median, and 
lowest rates of cooperation. From Azrin 
and Lindsley: The reinforcement of co- 
operation between children. 


and that the drop in rate during extinc- 
tion was due to the absence of the rein- 
forcing stimulus rather than satiation or 
fatigue. The rates of cooperation during 
the second reinforcement period and the 
last three minutes of the first reinforce- 
ment period were not significantly differ- 


TABLE 1 


The Median and Range of the Number of Cooperative Responses 
per Minute for the Critical Experimental Periods 


NUMBER OF COOPERATIVE RESPONSES PER MINUTE 


First three Last three Last three Last three 
N10 mins. of mins. of mins. of mins. of 
first reinf. first reinf. extinction second reinf. 
period period period period 
Median SS 17.5 15 17.5 
Range 1-26 6-26 0-7 6-27 


From Azrin and Lindsley: The reinforcement of coope 


ration between children. 
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ent and show that the rate was almost 
immediately restored to its pre-extinction 
value upon the presentation of reinforce- 
ment for the second time. The rate of 
cooperative responding during the first 
three minutes of the second reinforcement 
period was significantly higher than dur- 
ing the first three minutes of the first re- 
inforcement period (p < .02). This again 
shows that the reacquisition of coopera- 
tion was not gradual, as was initial acqui- 
sition, but occurred almost immediately. 


Conclusions 


Operant conditioning techniques can 
be used to develop, maintain, and elimi- 
nate cooperation between children without 
the use of specific instructions concerning 
cooperation. The rate of a cooperative 
response changes in much the same way 
as a function of single reinforcements as 
does an individual response. In the rein- 
forcement of cooperative responses, a re- 
inforcing stimulus need not be delivered 
to each member of the cooperative team 
following each cooperative response. The 


presentation of a single reinforcing stimu. 
lus, available to each member of the co- 
operative team, is sufficient to increase the 
rate of cooperation. The cooperative re- 
sponse gradually increases in frequency 
when reinforced and gradually decreases 
in frequency when no longer reinforced 
(extinction). Cooperative responses are 
maintained at a stable rate during rein- 
forcement but occur in sporadic bursts 
during extinction. Reinforcement follow- 
ing extinction results in an almost im- 
mediate restoration of the rate of coopera- 
tion to its pre-extinction value. 
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35. 
Justin and His Peers: An Experimental Analysis 
of a Child’s Social World**’ 


Donald J. Cohen 


The techniques of the experimental 
analysis of individual behavior developed 
in the researches of Pavlov, Watson, and 
Skinner have only recently been extended 
to human activities involving more than 
one person (2; 8, ch. 19). The methods 
of free operant conditioning allow for a 


* From D. J. Cohen, Justin and his peers: 
an experimental analysis of a child’s social 
world, Child Developm., 33, 697-717 
(1962). Reprinted by permission of the 
author and the Society for Research in 
Child Development. 

1 Dr, Ogden R. Lindsley, Director of 
the Behavior Research Laboratory, has in- 
fluenced this research and shaped the be- 
havior of the author in more ways than 
can possibly be enumerated. The interest 
Dr. Lindsley has shown, the guidance and 
criticism he has afforded, and the freedom 
he has allowed go far beyond that which 
any student has the right to expect. 

2The research was conducted at the 
Behavior Research Laboratory, Metropoli- 
tan State Hospital, Waltham, Massachu- 
setts, The experiments were supported by 
a special research grant from Brandeis 
University and Research Grant NSF 
G-9516 from the Division of Social Sci- 
ences, National Science Foundation. 


sensitive control of particular variables 
and for analysis of changes in behavior 
through time. This experimental ap- 
proach is thus methodologically suitable 
for the study of social transactions which 
are continuous (1, pp. 112-117) and 
which can be shown to be related to par- 
ticular classes of environmental events. 
While interviewing and questionnaire 
techniques can be used to obtain data on 
retrospective reports of behavior and atti- 
tudes or dispositions, the free operant 
method can be used in the analysis of 
ongoing behavior and the changes in be- 
havior which occur when people confront 
each other in a social situation. Also, 
while field observation is usually inexact 
and open to observer bias, the free oper- 
ant method allows for scientific control 
and precision in response definition and 
measurement. 

The first free operant experimental 
analysis of human social behavior (2) 
demonstrated the possibility of generat- 
ing cooperative behavior in young chil- 
dren through the scheduling of candy 
reinforcements. The cooperative behavior 
could be extinguished by withholding the 
reinforcements and regenerated through 
the rescheduling of the reinforcements. 

In this present paper, a new instrument 
for the experimental analysis of social be- 
havior is briefly described. The results of 
analysis of the social behavior of a par- 
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ticular young person are discussed. These 
results demonstrate that the young man 
behaves differently towards people with 
whom he has different nonexperimentally 
determined relations. Nonexperimental 
observations of the social behavior of the 
subjects support the clinical validity of 
the experimental findings. 


Method 
Susyects? 


The social behavior of Justin, a normal 
13-year-old, is studied in relation to peo- 
ple with whom he has different relation- 
ships. The five people involved in this 
analysis of Justin’s social profile are his 
brother (age 16), sister (age 14), close 
friend (age 13), mother, and a stranger 
(age 14). 


APPARATUS 


The experimental environment em- 
ployed throughout the experiments was 
two adjacent 6-ft. square rooms. Each 
room was equipped with a standard oper- 
ant conditioning panel on one wall (Fig- 
ure 1) as described by Lindsley (6). 
Mounted on each panel was a metal 
plunger; the plunger could be pulled with 
little effort and in some experiments has 
been pulled up to several thousand times 
within 90 minutes with no signs of fa- 
tigue. Located on each panel was a small 
bin into which the reinforcements (pen- 
nies and candy) were dropped. The two 
adjacent rooms were separated by a clear 


3 The kind of cooperation of the Sisters 
of the St. Joseph’s School, Waltham, 
Massachusetts, the students, and the par- 
ents who allowed their children to behave 
is greatly appreciated. 


plexiglass window through which the 
subjects could see each other when seated 
in front of the operant panels. . . 

Controlling and recording apparatus 
was located behind the experimental 
rooms in an adjoining area from which 
the experimental rooms were observed 
through concealed periscopes. A white 
noise generator delivered covering noise 
to concealed speakers in each room. The 
noise was maintained just loud enough to 
prevent any discussion between the sub- 
jects. 


Response DEFINITION 


There are two major response definition 
categories: team responses and individual 
responses (Figure 1). The latter involves 
only one subject, the former requires the 
participation of both. All response cate- 
gorization was performed automatically 
by switching circuits. As individual A 
pulled his plunger, an impulse shortener 
converted the movement into an electric 
impulse of .06 sec. duration. Similarly, B’s 
response was converted into an electric 
impulse. The impulses were fed into a 
sequence analyzer which categorized the 
responses into four groups: A followed by 
B (AB); B followed by A (BA); A fol- 
lowed by A (AA); B followed by B (BB). 
AB and BA were team responses; AA and 
BB were individual responses. 

In order to facilitate the study of so- 
cially defined, or team, behavior, the in- 
dividual responses were mildly punished. 
The punishment for an AA consisted of 
A’s room being darkened for 2.5 sec. dur- 
ing which a pure tone (500 cycles) was 
sounded through his speaker (see [5, p. 
35]). When either A or B was being 
blacked out, no responses entered the se- 
quence analyzer. 

The team responses are further defined 
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INDIVIDUAL RESPONSES 


BLACKOUT 


ALTERNATOR 


AA 


BLACKOUT 


on the basis of the temporal relationship 
between the two responses. An A response 
followed within .5 sec. by a B response is 
a Social AB. An A response followed 
within any period of time greater than .5 
sec, is a Nonsocial AB. Social BA and 
Nonsocial BA responses are defined analo- 
gously. The value of .5 sec. was chosen on 
the basis of exploratory investigation. The 
probability that a second response would 
follow the first within .5 sec. by chance 
alone (and without the production of AA 
or BB responses) was found to be slight. 
Team and individual responses of each 
category were simultaneously recorded on 
separate cumulative recorders and digital 
counters, The cumulative records provide 
a continuous measure of the ongoing $0- 
cial behavior throughout an experimental 
session. 


REINFORCEMENT CONTINGENCIES 


Cooperation is operationally defined in 
this study as behavior in which both sub- 


361 


TEAM RESPONSES 


NON SOC BA 
SOCIAL BA 
NON SOC AB 


SOCIAL AB 


FIG. 1. Schematic drawing of apparatus 
and response definition for individual and 
team responses. Each room is equipped 
with a metal plunger; movement of the 
plunger produces an electric impulse 
which is electrically defined into indi- 
vidual and team responses as shown in the 
block diagram. From Cohen: Justin and 
his peers: an experimental analysis of a 
child’s social world. 


jects are involved and in which both are 
reinforced. Competition is defined as be- 
havior in which both subjects are involved 
and only one is reinforced. That is, co- 
operation and competition are team re- 
sponses which are differentiated on the 
basis of the reinforcement, or “pay-off,” 
contingency. The horizontal rows of Fig- 
ure 2 list the four team responses that are 
differentially reinforced; the columns are 
the type of social behavior that is defined 
by the programmed reinforcement con- 
tingency. The italicized letters in the 
squares specify who is reinforced for each 
particular team response. Double entries 
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TEAM RESPONSE REINFORCEMENT CONTINGENCIES 


SOCIAL AB 


NON-SOC BA | 


UNCONTROLLED LEADERSHIP 


If 
COOPERATION | COMPETITION 


CONTROLLED LEADERSHIP 


|a Leaps]e Leaps A LEADS/B LEADS; 
coop. COOP. | COMP | COMP. 


INDIVIDUALS REINFORCED 


(AB) indicate that both subjects are rein- 
forced for that team response (coopera- 
tion). Single entries (A or B) indicate 
that only one subject is reinforced (com- 
petition), Empty squares indicate that no 
reinforcement is delivered for that team 
response (extinction). Individual re- 
sponses (AA and BB) are never positively 
reinforced. [Uncontrolled leadership re- 
fers to the case where reinforcement was 
delivered regardless of which subject (A 
or B) led. Controlled leadership required 
that the team response be made in a par- 
ticular order.] . . . 

The schedule of reinforcement was 
continuous (crf): for every reinforced 
team response a penny or piece of candy 
dropped into either one or both reinforce- 
ment bins on the operant panels (see [3]). 
Punishment was also on a continuous 
(crf) schedule: for every punished in- 
dividual response (AA or BB) the pun- 
ished subject (A or B) was blacked out 
as described above. 

Reinforcement consisted of a mixture 
of pennies and candy in an approximate 
ratio of four pennies to one candy (an 
assortment of gumdrops, pieces of choco- 
late, and other small candies). 


FIG. 2. Table of reinforcement contin- 
gencies used to differentially reinforce 
team responses. Double italicized entry 
(AB) indicates that both subjects are re- 
inforced for a team response. Single itali- 
cized entry (A or B) indicates which 
single subject is reinforced for a team 
response. An empty square indicates that 
the team response is programmed for ex- 
tinction. [The controlled leadership con- 
dition required that a particular subject 
lead; the uncontrolled condition did not.] 
From Cohen: Justin and his peers: an ex- 
perimental analysis of a child’s social 
world. 


EXPERIMENTAL SITUATION 


The two subjects were brought to the 
laboratory together by the experimenter. 
They were given a minimal amount of 
information concerning what was to take 
place, with instructions limited to the 
following: “You are going to play a game. 
You can keep all you get.” The subjects 
were then placed in the adjoining rooms 
in which the lights were dimmed. No 
other information was given the subjects 
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at any time during the experimental ses- 
sion. All changes in behavior thus were 
generated by specific, controlled changes 
in the experimental conditions or resulted 
from the “dynamic” aspects of social in- 
teraction. 

To clarify the experimental procedure, 
the first few moments of a characteristic 
experimental session will be outlined. The 
subjects were placed in the adjacent 
rooms; they sat down in front of the 
panels. The room lights went from dim 
to bright. . . . The subjects waited a min- 
ute or two and then explored the operant 
conditioning panels. They pulled the 
metal plungers. The initial reinforcement 
contingency was uncontrolled leadership 
during cooperation; that is, regardless of 
which subject led, so long as the other 
pulled his plunger within .5 sec., both 
were reinforced. A pulled his plunger; B 
pulled his within .5 sec. This constitutes 
a Social AB response. The room lights 
dimmed and a light went on in the rein- 
forcement bin on each panel (conditioned 
reinforcer). A penny (reinforcement) fell 
into the reinforcement bin in each room 
and the lights remained dim for 5 sec. (the 
conditioned reinforcement cycle). The 
room lights brightened. B pulled his 
plunger and A followed within .5 sec. This 
is a Social BA. The rooms were dimmed 
and a reinforcement delivered to each bin. 
When the lights brightened again, B 
pulled his plunger twice in a row (BB). A 
sequence of two responses by the same 
subject (individual responding) was 
mildly punished. B’s room darkened while 
a pure tone was delivered to his speaker 
for 2.5 sec. (black out B). When the 
lights went on again, either A or B could 
have led, and, so long as the other fol- 
lowed within .5 sec., both were reinforced 
by a penny dropping into both bins. . . . 
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QuestIonNAIRE REsuLTs; BRIEF SURVEY 


Each subject was asked to answer an 
informal questionnaire composed of sen- 
tences to be completed and several direct 
questions. The quotations in this paper 
attributed to the subjects are drawn 
mainly from the answers given to this 
questionnaire. . . . 


Summary AND Discussion 


The average reinforcement received by 
each subject for each experimental session 
was over $6.25. Most of the candy was 
eaten in the rooms. All the subjects in 
these experiments have asked if they 
could return to the laboratory. Sensitive 
behavioral analysis requires such highly 
motivated behavior. 

A summary of Justin’s experimentally 
determined social profile is presented in 
Table 1. A synopsis of the social behavior 
of the five teams in four different rein- 
forcement contingencies (see Figure 3) 
demonstrates the differences in Justin’s 
social behavior in each team. 

Justin led those people with whom he 
had previous nonexperimental experience 
of leadership, his brother and his friend. 
His sister who “mothers” him and his 
mother look strikingly similar during co- 
operation: both were strong leaders dur- 
ing uncontrolled leadership and both 
exhibited resistance to following him by 
bursts of inappropriate leadership re- 
sponding when they were not reinforced 
for leading. With Justin and the friend, 
the stranger, and his mother, the competi- 
tive contingency was converted into com- 
plex cooperation. Justin and his sister 
displayed strong competition. 

Justin has occupied more of his parents’ 
attention than any of the other six chil- 
dren in the family, and the results of this 
family situation are reflected in the experi- 
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TABLE 1 
Justin’s Social Profile 
UNCONTROLLED CONTROLLED LEADERSHIP UNCONTROLLED 
TEAM LEADERSHIP Justin's lead Others lead COMPETITION 

Justin and... reinforced reinforced 
Brother Justin leads. Long acquisition. Shorter acquisi- 

Long acquisi- Brother persists tion. Justin slow 

tion. Individual in leading. to follow. 

responses. 

Friend Justin leads; Rapid acquisition. Rapid acquisi- Alternation of 
halts friend’s at- tion. Justin leadership. 
tempts to lead. slow to 

follow. 

Stranger Stranger leads Unstable compe 

strongly. tition becomes 
alternation of 
leadership. 

Sister Sister leads Rapid acquisition. Competition. 
strongly. Bursts of sister 

responding. 

Mother Mother leads Rapid acquisition. Rapid acquisition. Alternation of 

strongly. Bursts of mother leadership. 
Tesponding. 


Note. No entry—condition not used. From Cohen: Justin and his peers: an experi 


mental analysis of a child’s social world. 


mental analysis. Both his older brother 
and his immediately younger sister (age 
12, not used in this experiment) have had 
psychiatric treatment for behavioral prob- 
lems. The 12-year-old sister suffered from 
trichotillomania but is now recovered; his 
older brother still shows signs of [earlier 
behavior problems] Justin’s older sister 
(age 14) manifests her envy and aggres- 
sion by “mothering” him; his older 
brother manifests his by trying to under- 
rate Justin’s accomplishments and by try- 
ing to prevent further achievement. These 
Justin-sister and Justin-brother interac- 
tions are evidenced in the experimental 
analysis by the slow development of co- 
operation and control of leadership 


(Justin-brother) and the strong leader- 
ship accompanied by true competition 
(Justin-sister). The experimental analysis 
is validated by such statements as Justin's 
mother’s in relation to her children: “They 
are the most competitive, aggressive 
group you ever met.” The experimental 
analysis has successfully evaluated the type 
of expression given the “competitive, ag- 
gressive” family spirit. 

Justin and his friend had a long history 
of extra-experimental cooperation. Their 
experimental behavior is fully cooperative 
with immediate alternation of leadership 
during programmed competition. Justin 
and the stranger had no history of extra- 
experimental cooperation; after initial 
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competition during programmed competi- 
tion, their experimental behavior changed 
into the more complex form of coopera- 
tion. Justin and his brother had a long 
history of competition and aggression; 
their experimental behavior is marked by 
a large number of nonteam responses, 
long periods of acquisition, persistence of 
nonreinforced leading, and the other oc- 
currences noted above. 

‘The results of these experiments clearly 
demonstrate that Justin’s social behavior is 
differentially controlled by reinforcement. 
However, the dynamic properties of his 
social behavior are controlled by his previ- 
ous extra-experimental relations with his 
teammates. Different patterns with differ- 
ent teammates prove that the method is 
sensitive to different social relationships. 
Further, the results of the experimental 
analysis are validated by the information 
gathered from the questionnaires and 
interviews. The experimental analysis, 
[however], indicates that the actual social 
behavior of an individual may contradict 
the statements made by that person con- 
cerning the social transaction (e.g. Justin 
and his mother). 

‘The experimental analysis adds definite- 
ness and precision to the non-experimental 
information concerning the subject’s social 
interactions. Also, it is possible to further 
refine the type of behavior engaged in by 
the subjects as manifestations of such 
clinically relevant concepts as aggression, 
competition, unwillingness to follow, etc. 
For example, an analysis of unwillingness 
to follow has shown that it is expressed in 
both (a) leading when not being rein- 
forced for leading and (b) hesitancy to 
respond after the leader has responded. 
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Both (a) and (b) are manifested in the 


same experimental social circumstances by 
different individuals. . . . 


Conclusions 


The experimental determination of five 
different dynamic patterns of cooperative 
and competitive leadership between a 
young man and five other persons clearly 
demonstrates the sensitivity of this free 
operant method to important social varia- 
bles. The close similarity between the ex- 
perimentally measured patterns and the 
extra-experimental relationships as deter- 
mined by questionnaires and interviews 
demonstrates that these experimental 
measures have high validity. The method 
permits a laboratory analysis of a child’s 
social world. 
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36. 
The Formation of Positive Attitudes 
Toward Group Members*’ 


Bernice Eisman Lott and 
Albert J. Lott 


In an attempt to predict group behavior 
on the basis of general psychological prin- 
ciples as contrasted with formulations 
specific to the area, the concept of group 
cohesiveness has been re-examined and 
reformulated within a learning theory 
framework (Lott, in press). Within this 
framework, cohesiveness is defined as that 
group property which is inferred from the 
number and strength of mutual positive 
attitudes among the members of a group. 
The concept of attitude is used, instead 
of the more usual one of attraction, be- 
cause of its precise and particular mean- 
ing within learning theory, i.e. an im- 
plicit anticipatory response having cue 
and drive properties (Doob, 1947). By 
defining cohesiveness in terms of mutual 


*From B. E. Lott and A. J. Lott, The 
formation of positive attitudes toward 
group members, J. abnorm. soc. Psychol., 
61, 297-300 (1960). Reprinted by per- 
mission of the authors and the American 
Psychological Association. 

1A paper, based on this investigation, 
was read at the 1959 American Psycho- 
logical Association meetings in Cincinnati. 


positive attitudes among group members, 
the assumption is made that the members 
who comprise a group constitute its most 
significant components. 

A number of hypotheses regarding both 
the antecedents and consequents of co- 
hesiveness, as defined above, have been 
derived from learning theory (Lott, in 
press). The problem of this experiment 
has been to test the most fundamental of 
these hypotheses, one which concerns the 
conditions under which positive attitudes 
toward group members may be formed. 

It is predicted that if a person is re- 
warded in the presence of others (fellow 
group members), he will develop positive 
attitudes toward them. This proposition 
tests upon the following assumptions: 

l. Persons may be conceptualized as 
discriminable stimuli to which responses ` 
may be learned. 

2. A person who experiences reinforce- 
ment or reward for some behavior will 
react to the reward, i.e., will perform 
some observable or covert goal response 
(Rg or tg). 

3. This response to reward will become 
conditioned, like any other response, to 
all discriminable stimuli present at the 
time of reinforcement. 

4. A person (group member) who is 
present at the time that Individual X, for 
example, is rewarded thus becomes able, 
in a later situation, to evoke R, or, what 
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is more likely, its fractional and antici- 
patory component, rz — Sg. This latter re- 
sponse, which Hull has called “expecta- 
tive” (1952, Ch. 5), was earlier inter- 
preted by Doob (1947) as the underlying 
mechanism of an attitude. 

The specific prediction tested by this 
study is that members of three-person 
groups who are rewarded for their per- 
formance in the presence of their fellow 
group members will more likely develop 
positive attitudes toward them than will 
members of such groups who are not re- 
warded. Positive attitudes are inferred, 
here, from choices made on a sociometric 
test subsequent fo, and outside of, the 
experimental situation. 


Method 
SUBJECTS 


Forty-eight children from the Univer- 
sity of Kentucky Elementary School, 24 
each from Grades 3 and 5, served as Ss.? 


PROCEDURE 


The Ss were divided into 16 three-mem- 
ber groups, following the administration 
of two sociometric tests. These tests were 
given, by the regular classroom teachers, 


2 The authors wish to acknowledge the 
cooperation of the following persons whose 
kind assistance made possible both the re- 
ported experiment and the pilot work 
which preceded it: M. Hitch, Principal of 
Rosenwald Laboratory School, Frankfort, 
Kentucky; A. Wolfe, intermediate grade 
teacher at Rosenwald; E. Sasman, Principal 
of University Elementary School, Lexing- 
ton, Kentucky; A. Boone, M. Moore, and 
O. Barrett, teachers at University School of 
the third, fourth, and fifth grades, respec- 
tively. 
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on two consecutive days, several days be- 
fore the actual experimental situation. On 
the basis of the test results the groups 
were formed so that each group was 
made up of children who had not chosen 
each other on either of the tests. Four all 
male and four all female groups were 
formed from Grade 3; five male and three 
female groups were formed from Grade 5, 
Omitting the preliminary instructions, 
the criterion question asked in the first 
test was as follows: 


Test I. Let us suppose that each one of 
you gets picked to tke a trip to the moon 
in a rocket ship. This is a very special trip. 
. . . It is important for everyone who is on 
the same ship to get along well with each 
other. . . . Because of this you get a chance 
to pick two children to go along with 
you. Now, of all the children in this class, 
which two would you pick to travel in the 
same rocket ship with you? 

Test II. [For this test the children were 
asked to think of themselves as visitors from 
Mars and to choose two classmates whom 
they would like to have waiting for them 
when their spaceship landed on Earth.] 


For a group situation in which rewards 
and nonrewards could be manipulated, a 
board game called “Rocket Ship” was de- 
vised. The object of the game, played by 
groups of three, is to land cardboard 
rocket ships on planetary objectives. 
Each objective is reached by traversing a 
separate path containing four danger 
zones, at each of which a choice between 
a white and a striped subpath (one “safe” 
and the other “dangerous”) must be 
made. By having the children in a group 
take turns crossing the danger zones first, 
the Es could arrange to have some chil- 
dren succeed and others fail in reaching 
the planets safely. The manner in which 
this was accomplished will be described 
below. 

On the day of the experiment proper 
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(separate days for the two classes), the 
Es were introduced to Ss as having de- 
veloped a children’s game which they 
wished to test. One group at a time was 
called upon (in a predetermined random 
order) to play the game in a room adjoin- 
ing the regular classroom.* The following 
instructions, given to each group by one 
of the investigators (E,), describe the 
manner of playing: 


. . . You three are rocket ship pilots. 
Each one of you has your own ship but you 
are going to take a trip into outer space to- 
gether, side by side. The first trip you are 
going to take is to . In order to get there 
you must follow this path which scientists 
have decided is the safest way to go. The 
scientists also know that, at a few points 
along the way on this path, there is great 
danger. When you get to one of these dan- 
gerous points you are going to have to stop 
and decide whether the striped path or the 
white path is the dangerous one. One of the 
paths will get you past the danger safely. If 
you take the wrong path your rocket ship 
will be blown up and you'll have to para- 
chute to Earth. . . . When you get to a 
danger point you'll have to decide which one 
of the group will take a chance and be the 
first to try either the striped or white path. 
If he gets through safely, the other two 
rockets may follow him. If his ship should 
get blown up, though, the other two ships 
will take the other path which you will know 
to be safe. You'll know that a ship has been 
blown up when you hear the sound of a bell, 
like this [sounded by Es]. . . . Remember, 
you must take turns being first. 

. . . It’s possible for all three of you to 
get through to a planet safely, but it may be 
that only two of you will make it, and maybe 


3 Wherever a child, preselected for a 
particular group, was absent on the day of 
the experiment, a substitute who met the 
criterion of nonchoice by, and of, the 
other group members, was, in all cases, 
available. 


just one or none of you will make it. . . . If 
you reach a planet safely you will be able to 
choose one of these prizes [small plastic auto 
models] which you may keep. . . . We'll 
play half the game this morning and half 
this afternoon. 


Each group tried for three objectives in 
the morning and three in the afternoon. 
Half the total number of Ss was permitted 
to land safely on four planets (two at each 
session) while half was prevented from 
teaching any of them. “Reward” was thus 
defined as the receipt of four plastic car 
models (one for each successful landing). 
A child was either “rewarded” or “not- 
rewarded,” i.e., made no successful land- 
ings at all and received no prizes; there 
were no in-between conditions. Prizes won 
in the morning session were held by the 
Es until the end of the afternoon session 
at which time the rewarded Ss returned to 
their classroom with four model cars and 
the nonrewarded Ss returned with none. 

Rewarded and nonrewarded Ss were 
selected on a random basis prior to the 
game. A nonrewarded S always had his 
ship “blown up” when, at his chance to go 
first at a danger point, he took either the 
striped or white path.* As soon as he made 
his choice of path, the “blow up” bell 
was rung by E> who sat somewhat apart 
from the game area. 

Each group had been randomly as- 
signed, prior to the game situation, to one 


4 Each child was in the position of “be- 
ing first” at a danger point at least once 
on his way to each of the planets since Ss 
had been instructed to take turns and there 
were four danger zones per path and three 
children in a group. It was always possible, 
therefore, to “blow up” nonrewarded Ss 
without interfering with a group’s spon- 
taneous behavior regarding which child 
would go first at which point. 
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of the following conditions which de- 
scribe the number of group members who 
were to be rewarded during the game: 
zero, one, two, all, Four groups, two from 
each class, were assigned to each condi- 
tion. This aspect of the design was intro- 
duced to avoid having the Ss suspect that 
the game was “rigged.” The natural flavor 
of the game was maintained by having Ss 
know that it was possible for all three 
group members to be successful, or only 
two, etc. 

Shortly before the close of the school 
day, approximately one hour after the last 
group had played the game, the classroom 
teacher administered another sociometric 
test (IIT), as follows: 


Suppose your family suddenly got the 
chance to spend your next vacation on a 
nearby star out in space . . . you can invite 
two children to go on the trip . . . and 
spend the holiday with you on the star. 
Which two children in this class would you 
choose to take with you? 


After the choices were collected by the 
teacher, Eg appeared before the class to 
thank the Ss for their cooperation and 
help. And, because everyone had been 
such “good sports,” four prizes were dis- 
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tributed to each of the youngsters who 
had not won them during the game. 


Results 


The results of the final sociometric test 
(IIL), which succeeded the play-group ex- 
perience, are presented in Table 1. The 
proportion of play-group members chosen 
by rewarded Ss was found to be signifi- 
cantly greater than the proportion chosen 
by nonrewarded Ss. The obtained critical 
ratio, corrected for continuity, is 2.14 (p 
= .03; two-tailed). This confirms the pre- 
diction that Ss who had been rewarded 
would choose members of their groups, on 
the final sociometric test, significantly 
more often than Ss who had not been 
rewarded. 


DISCUSSION 


The present findings indicate that the 
formation of positive attitudes toward 
persons is predictable from learning the- 
ory principles and can be studied in the 
laboratory. This study thus extends the 
applicability of a general S-R framework 
to significant social behavior. 


TABLE 1 
Choices Made by Subjects on Sociometric Test m 
ee 


CHOICES 
Subjects Non- 
play-group _play-group Na 
member member 
Rewarded 11l 37 p 
Nonrewarded 3 45 


a N = number of choices made; 


each S made two choices. 


From Lott and Lott: The formation of positive attitudes 


toward group members. 
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The prediction that positive attitudes 
toward persons can be formed by experi- 
encing reward in their presence, was 
clearly confirmed. Since it is in terms of 
such positive attitudes among the mem- 
bers of a group that cohesiveness has been 
defined, the present experiment is seen to 
be concerned with the antecedents or de- 
terminants of cohesiveness even though 
no attempt was made to measure the 
variable directly. The specific concern of 
this first study was with the development 
of positive attitudes toward group mem- 
bers and not with the group property that 
results from such attitudes when they are 
mutual.® 

There have been comparatively few ex- 
perimental attempts to vary group co- 
hesiveness other than by suggesting to the 
members of a group that they will like 
each other. One investigation in which 
determinants were experimentally manip- 
ulated (Thibaut, 1950) found a positive 
relationship between cohesiveness and 
group status. In another study, more rele- 
vant to the present one (Bovard, 1951), a 
significantly greater level of interpersonal 
affect was found in group-centered as 
compared with traditional leader-centered 
classes. Bovard suggested that this result 
was due to the fostering, in group-centered 
classes, of member-to-member interaction 
which produces greater accuracy in inter- 
member perception, creating, according 
to Bovard, a situation conducive to “need 
satisfaction.” That the experience of need 
satisfaction (reward) in the presence of 
group members can, indeed, result in posi- 


5 An operational measure of cohesiveness 
which follows directly from the definition 
of the concept given earlier has been de- 
veloped by the investigators and will be re- 
ported in connection with its use in an- 
other study. 


tive affect toward those group members 
has been demonstrated in the present ex- 
periment. 

The results obtained in this study 
should be evaluated in the light of the 
following factors which could only have 
tended to work against substantiation of 
the hypothesis: 

1. Play-group members were, by design, 
neutral or negative stimuli for one another 
at the beginning of the experimental situ- 
ation. This was assured by placing, in a 
group, only Ss who had not chosen one 
another on two previous sociometric tests. 

2. The amount of reward experience re- 
ceived by rewarded Ss in the presence of 
others was extremely small when com- 
pared with the amount of daily contact 
our Ss typically had with each other in the 
classroom, playground, and after school. 
(Practically all the Ss in each of the 
classes had been together for their entire 
schooling, beginning with kindergarten.) 

3. The choices made on the two pre- 
experimental sociometric tests (I and IT) 
were found to be unexpectedly stable for 
third and fifth graders, indicating rela- 
tively reliable friendship ties? which the 
experimental experience was able to dis- 
rupt, however temporarily.’ 

Despite the above factors the predic- 
tion, that positive attitudes toward per- 
sons will be developed as a result of the 
receipt of reward in their presence, was 
clearly supported. Though the results 


6 Forty percent of the Ss made the same 
two choices on both tests; another 42% 
of the Ss repeated one choice on both tests. 

7 No follow-up test was given since there 
was no reason to expect that the positive 
attitudes formed during the brief game sit- 
uation would last, in the absence of con- 
tinued reward experience in the presence 
of the same individuals. 


THE FORMATION OF POSITIVE ATTITUDES TOWARD GROUP MEMBERS 


were obtained with children, there is no 
reason to expect that they would not hold 
with adults as well. Such generalization 
must, of course, await adequate test. 

The variable manipulated in the pres- 
ent study was simply reward vs. nonre- 
ward. Future research might profitably 
deal with variations in reward frequency, 
delay, and schedule, for example, as these 
affect the conditioning of attitudinal re- 
sponses, and, consequently, as these affect 
the development of cohesiveness in small 
groups. That the results obtained in this 
study were predicted from general behav- 
ior principles increases our confidence in 
the promise which this kind of an ap- 
proach holds for the general area of small 
group behavior. 


SUMMARY 


Three-member groups of children 
played a game in which some members 
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were rewarded and others were not. On a 
later sociometric test, outside of the game 
situation, rewarded Ss chose a significantly 
greater proportion of their fellow group 
members than did the nonrewarded Ss. 
These results were predicted from general 
principles of S-R learning theory. 
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3T- 
A Comparative Test of the Status Envy, Social Power, 
and the Secondary Reinforcement Theories 
of Identification Learning*’ 


Albert Bandura, Dorothea Ross,” 
and Sheila Ross 


Although it is generally assumed that 
social behavior is learned and modified 
through direct reward and punishment of 
instrumental responses, informal observa- 
tion and laboratory study of the social 
learning process reveal that new responses 
may be rapidly acquired and existing be- 
havioral repertoires may be considerably 
changed as a function of observing the 
behavior and attitudes exhibited by mod- 
els (Bandura, 1962). 


* From A. Bandura, D. Ross, and S. A. 
Ross, A comparative test of the status 
envy, social power, and the secondary 
reinforcement theories of identification 
learning, J. abnorm. soc. Psychol., 67, 
527-534 (1963). Reprinted by permission 
of the authors and the American Psycho- 
logical Association. 

1 This investigation was supported by 
Research Grant M-5162 from the National 
Institutes of Health, United States Public 
Health Service. 

The authors are indebted to Beverly 
Busching, Malka Yaari, Nancy Wiggins, 
and John Steinbruner, who assisted in col- 
lecting the data. 


The latter type of learning is generally 
labeled “imitation” in behavior theory, 
and “identification” in most theories of 
personality. These concepts, however, are 
treated in the present paper as synony- 
mous since both encompass the same be- 
havioral phenomenon, i.e., the tendency 
for a person to match the behavior, atti- 
tudes, or emotional reactions as exhibited 
by actual or symbolized models. While 
the defining properties of identification 
are essentially the same in different per- 
sonality theories, a host of divergent learn- 
ing conditions have been proposed as the 
necessary antecedent variables for match- 
ing or identificatory behavior (Bronfen- 
brenner, 1960; Freud, 1946; Freud, 1924, 
1948; Kagan, 1958; Klein, 1949; Maccoby, 
1959; Mowrer, 1950; Parsons, 1955; Sears, 
1957; Whiting, 1960). 

In the experiment reported in this 
paper predictions were derived from three 
of the more prominent theories of learn- 
ing by identification, and tested in three- 
person groups representing prototypes of 
the nuclear family. In one condition of 
the experiment an adult assumed the role 


2 This research was carried out while 
the junior author was the recipient of an 
American Association of University Women 
International Fellowship for post-doctoral 
research, 
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of controller of resources and positive 
reinforcers. Another adult was the con- 
sumer or recipient of these resources, 
while the child, a participant observer in 
the triad, was essentially ignored. In a 
second treatment condition, one adult 
controlled the resources; the child, how- 
ever, was the recipient of the positive 
reinforcers and the other adult was as- 
signed a subordinate and powerless role. 
An adult male and female served as 
models in each of the triads. For half the 
boys and girls in each condition the male 
model controlled and dispensed the re- 
warding resources, simulating the hus- 
band dominant family; for the remaining 
children, the female model mediated the 
positive resources as in the wife dominant 
home. Following the experimental social 
interactions the two adult models ex- 
hibited divergent patterns of behavior in 
the presence of the child, and a measure 
was obtained of the degree to which the 
child subsequently patterned his behavior 
after that of the models. 

According to the status envy theory of 
identification recently proposed by Whit- 
ing (1959, 1960), where a child competes 
unsuccessfully with an adult for affection, 
attention, food, and care, the child will 
envy the consumer adult and conse- 
quently identify with him. Whiting’s 
theory represents an extension of the 
Freudian defensive identification hypoth- 
esis that identificatory behavior is the out- 
come of rivalrous interaction between the 
child and the parent who occupies an 
envied consumer status. While Freud pre- 
sents the child as in competition with the 
father primarily for the mother’s sexual 
and affectional attention, Whiting re- 
gards any forms of reward, material and 
social, as valued resources around which 
rivalry may develop. The status envy 
theory thus predicts that the highest de- 


373 


gree of imitation by the child will occur 
in the experimental condition in which 
the rivalrous adult consumes the resources 
desired by the child, with the consumer 
adult serving as the primary object of 
imitation. 

In contrast to the envy theory, other 
writers (Maccoby, 1959; Mussen & Dist- 
ler, 1959; Parsons, 1955) assume that the 
controller, rather than the consumer, of 
resources is the main source of imitative 
behavior. The power theory of social in- 
fluence has received considerable atten- 
tion in experimental social psychology, 
though not generally in the context of 
identification theories. 

Social power is typically defined as the 
ability of a person to influence the be- 
havior of others by controlling or medi- 
ating their positive and negative rein- 
forcements. French and Raven (1959) 
have distinguished five types of power 
based on expertness, attractiveness, legiti- 
macy, coerciveness, and rewarding power, 
each of which is believed to have some- 
what differential effects on the social in- 
fluence process. For example, the use of 
threat or coercion, in which the controller 
derives power from his ability to admin- 
ister punishments, not only develops 
avoidance behavior toward the controller 
but also decreases his attractiveness and 
hence his effectiveness in altering the be- 
havior of others beyond the immediate 
social influence setting (French, Mor- 
rison, & Levinger, 1960; Zipf, 1960). The 
use of reward power, in contrast, both 
fosters approach responses toward the 
power figure and increases his attractive- 
ness or secondary reward value through 
the repeated association of his attributes 
with positive reinforcement. Attractive- 
ness is assumed to extend the controller’s 
power over a wide range of behavior 
(French & Raven, 1959). 
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In the present investigation power 
based upon the ability to dispense re- 
wards was manipulated experimentally. In 
accordance with the social power theory 
of identification, but contrasting with the 
status envy hypothesis, one would predict 
that children will reproduce more of the 
behavior of the adult who controls posi- 
tive reinforcers, than that of the powerless 
adult model, and that power inversions 
on the part of the male and female 
models will produce cross-sex imitation. 
The secondary reinforcement theory of 
identification, which has been alluded to 
in the discussion of social power through 
attractiveness, has been elaborated in 
greatest detail by Mowrer (1950, 1958). 
According to this view, as a model medi- 
ates the child’s biological and social re- 
wards, the behavioral attributes of the 
model are paired repeatedly with positive 
reinforcement and thus acquire secondary 
reward value. On the basis of stimulus 
generalization, responses which match 
those of the model attain reinforcing 
value for the child in proportion to their 
similarity to those made by the model. 
Consequently, the child can administer 
positively conditioned reinforcers to him- 
self simply by reproducing as closely as 
possible the model’s positively valenced 
behavior. This theory predicts that the ex- 
perimental condition in which the child 
was the recipient of positive reinforce- 
ments will yield the highest imitation 
scores with the model who dispensed the 
rewards serving as the primary source of 
imitative behavior. 


Method 
SUBJECTS 


The subjects were 36 boys and 36 girls 
enrolled in the Stanford University Nurs- 


ery School. They ranged in age from 33 to 
65 months, although the variability was 
relatively small with most of the ages fall- 
ing around the mean of 51 months. 

An adult male and female served as 
models in the triads so as to reproduce 
possible power structures encountered in 
different types of family constellations. A 
female experimenter conducted the study 
for all 72 children. 


DESIGN AND PROCEDURE 


The subjects were assigned randomly 
to two experimental groups and one con- 
trol group of 24 subjects each. Half the 
subjects in each group were males, and 


half were fe : 
High xewarding power was induced ex- 
perimentally through the manipulation of 


material and social reinforcements, and 
the use of verbal structuring techniques. 
While accompanying the child to the ex- 
perimental room, for example, the experi- 
menter informed the child that the adult 
who assumed the role of controller owned 
the nursery school “surprise room,” as 
well as a fabulous collection of play ma- 
terials. After introducing the child to 
the controller, the experimenter asked 
whether the child may play in the surprise 
room. The controller explained that he 
was on his way to his car to fetch some of 
his most attractive toys, but the experi- 
menter and the child could proceed to the 
room where he would join them shortly. 
As the controller left, the experimenter 
commented on how lucky they were to 
have access to the controller’s play ma- 
terials. 

On the way to the experimental room 
they met the other adult who insisted on 
joining them but the experimenter in- 
formed her that she would have to obtain 
permission from the controller since he 
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owned the room, and it was doubtful 
whether sufficient play materials were 
available for both the adult and the child. 
This brief encounter with the other adult 
was designed primarily to create the set 
that rewards were available to one person 
only and thereby to induce rivalrous feel- 
ings over the controller’s resources. 

As soon as the experimenter and the 
child arrived in the experimental room, 
they sat down at a small table and played 
with the few Lincoln Logs and two small 
cars that were provided. A short time 
later the other adult appeared and an- 
nounced that the controller also granted 
her permission to play in the room. 

The controller ‘then entered carrying 
two large toy boxes containing a variety 
of highly attractive masculine and femi- 
nine toys, a colorful juice dispensing 
fountain, and an ample supply of cookies. 
As soon as the controller appeared on the 
scene, the experimenter departed. 

For children in the Adult Consumer 
condition, the adult who assumed the role 
of consumer requested permission to play 
with the articles and the controller replied 
that, since the child appeared to be occu- 
pied at his table, the consumer was free to 
use the play materials. This monopolistic 
move by the consumer adult left the child 
stranded at a table with two relatively un- 
interesting toys. 

During the 20-minute play session, the 
controller offered the consumer, among 
other things, miniature pinball machines, 
mechanical sparkling toys, kaleidoscopes, 
dolls, and actively participated with the 
consumer in dart games and other activi- 
ties. To add to the credibility of the situ- 
ation, both the controller and consumer 
devoted most of their attention to articles, 
such as the pinball machine and dart 
game, which could be used in adult appro- 
priate activities. Throughout the inter- 
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action the controller was most helpful, 
supportive, and generous in dispensing 
social reinforcers in the form of praise, 
approval, and positive attention. The con- 
sumer, in turn, commented frequently on 
the controller’s highly attractive resources 
so as to further enhance the controller's 
rewarding status. The consumer also 
verbalized considerable positive affect 
characteristic of a person experiencing 
positive reinforcements. 

Approximately half way through the 
session, the controller remarked, “Say, 
you look hungry. I have just the thing for 
you.” He then brought forth the soda 
fountain dispenser, poured colorful fruit 
juices into paper cups and served them to 
the consumer along with a generous sup- 
ply of cookies. While the consumer was 
enjoying his snack, the controller turned 
on a “T'V-radio” that played a nursery 
melody while a revolving dial displayed a 
series of storybook scenes. 

Toward the end of the session, the con- 
troller informed the consumer that he will 
be leaving on a shopping trip to San 
Francisco that afternoon, and asked the 
consumer if there was anything special 
she would like him to buy for her. The 
consumer requested a super two-wheel 
bicycle, a high status object among the 
nursery school children, The controller 
promised to purchase the bicycle along 
with any other items the consumer might 
think of before the controller departed for 
the city. 

The procedure for the Child Consumer 
condition was identical with that de- 
scribed above except the child was the 
recipient of the material rewards and the 
social reinforcement. During the session 
the other adult sat at the opposite end of 
the room engrossed in a book, and was 
totally ignored by the controller. In dis- 
cussing the prospective San Francisco 
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shopping trip, the controller mentioned 
to the child that he was planning to visit 
some toy stores in the city that afternoon, 
and asked for suggestions of attractive toys 
he might purchase for future play sessions 
with children. 

For half the boys and girls in each treat- 
ment condition the male model controlled 
and dispensed the resources, simulating 
the husband dominant family; for the re- 
maining children the female model medi- 
ated the positive resources as in the wife 
dominant home. 

At the completion of the social inter- 
action session the controller announced 
that he had a surprise game in his car that 
the three of them could play together. 
The controller then asked the other adult 
to fetch the experimenter to assist them 
with the game, and as soon as the adult 
departed, the controller removed the toys 
and assembled the imitation task appa- 
ratus. 


IMITATION TASK 


The imitation task was essentially the 
same two-choice discrimination problem 
utilized in an earlier experiment (Bandura 
& Huston, 1961), except the response 
repertoires exhibited by the models were 
considerably extended, and the procedure 
used in the acquisition trials was some- 
what modified. 

The apparatus consisted of two small 
boxes with hinged lids, identical in color 
and size. The boxes were placed on stools 
approximately 4 feet apart and 8 feet from 
the starting point. On the lid of each box 
was a rubber doll. 

As soon as the other adult returned with 
the experimenter, the controller asked 
both the child and the experimenter to be 
seated in the chairs along the side of the 
room, and the other adult to stand at the 


starting point, while the controller de- 
scribed the game they were about to play. 
The controller then explained that the 
experimenter would hide a picture sticker 
in one of the two boxes and the object of 
the game was to guess which box con- 
tained the sticker. The adults would have 
the first set of turns, following which the 
child would play the guessing game. 

The discrimination problem wa 
ployed simply as a cover task that occu- 
pied the children’s attention while at the 
same time permitted observation o 
models as they performed divergeni 
terns of behavior during the discrimina 
tion trials in the absence of any to 
attend to or learn the responses exhibited 
by the models. 

Before commencing the trials, the 
troller invited the other participants to 
join him in selecting a “thinking cap” 
from hat racks containing two identical 
sets of four sailor caps, each of which had 
a different colored feather. The controller 
selected the green feathered hat, remarked, 
“Feather in the front” and wore the hat 
with the feather facing forward. The other 
model selected the yellow feathered ‘at, 
commented, “Feather in the back,” and 
placed the hat on her head with the 
feather facing backward. The child then 
made his choice from the four hats in the 
lower rack and it was noted whether he 
matched the color preference, hat place- 
ment, and the verbal responses of the one 


“or the other model. 


The models then went to the starting 
point, the child returned to his seat, and 
the experimenter loaded both boxes with 
sticker pictures for the models’ trials. 

During the execution of each trial, each 
model exhibited a different set of rela- 
tively novel verbal and motor responses 
that were totally irrelevant to the discrimi- 
nation problem to which the child’s atten- 
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tion was directed. At the starting point 
the controller stood with his arms crossed, 
but at the experimenter’s warning not to 
look, the controller placed his hands over 
his € faced sideways and asked, 


“Read?” The other model stood with his 


arms on his hips, then squatted with his 
back ned to the boxes and asked, 
“Nov 

As soon as the experimenter gave the 
signal for the first trial, the controller re- 
marked, “Forward march” and began 
marc! slowly toward the designated 
box eating, “March, march, march.” 
When he reached the box he said, “Sock 
him,” hit the doll aggressively off the box, 
opened the lid and yelled, “Bingo,” as he 
reached down for the sticker. He then re- 
marked, “Lickit-sticket,” as he pressed on 
the picture sticker with his thumb in the 
upper-right quadrant of a 24 x 24 inch 
sheet of plain white paper that hung on 


the wall immediately behind the boxes. 
The controller terminated the trial by re- 
placing the doll facing sideways on the 
container with the comment, “Look in 
the mirror,” and made a final verbal re- 
sponse, “There.” 

The other model then took her turn 
and performed a different set of imitative 
acts but equated with the controller's re- 
sponses in terms of number, types of 
response classes represented, structural 
properties, and interest value, At the start- 
ing point, for example, she remarked, 
“Get set, go” and walked stiffly toward 
the boxes repeating “Left, right, left, 
tight.” When she reached the container 
she said, “Down and up,” as she lay the 
doll down on the lid and opened the box. 
She then exclaimed, “A stickeroo,” re- 
peated, ““Weto-smacko,” and slapped on 
the sticker with the open hand in the 
lower-left quadrant of the sheet of paper. 
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In terminating the trial, the model lay the 
doll on the lid of the container with the 
remark, “Lie down,” and returned with 
her hands behind her back, and emitted 
the closing remark, “That’s it.” 

‘The two sets of responses were counter- 
balanced by having the models display 
each pattern with half the subjects in each 
of the three groups. 

The models performed alternately for 
four trials, At the conclusion of the fourth 
trial the controller explained that he had 
to check some materials in his car and 
while he and the other model were away 
the child may take his turns. Before they 
departed, however, the experimenter ad- 
ministered a picture preference test in 
which the models were asked to select 
their preferred picture from six different 
stickers pasted on a 5 x 8 inch card, after 
which the child was presented a similar 
card containing an identical set of stickers 
and requested to indicate his preference. 

In addition to the introductory block 
of four trials by the models, the child’s 15 
total test trials were interspersed with 
three two-trial blocks by the models. The 
models were always absent from the room 
during the child’s test series. This pro- 
cedure was adopted in order to remove 
any imagined situational restraints against, 
or coercion for, the child to reproduce the 
models’ responses. Moreover, demonstra- 
tions of delayed imitation in the absence 
of the model provides more decisive evi- 
dence for learning by means of imitation, 

The models always selected different 
boxes, the right-left position varying from 
trial to trial in a fixed irregular order, and 
the controller always took the first turn. 
Although the models received stickers on 
each trial, the child was nonrewarded on 
one third of the trials in order to maintain 
his interest in the cover task. 
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At the beginning of each of the blocks 
of subjects’ trials, the experimenter ad- 
ministered the picture preference test and 
the selection of stickers that matched the 
models’ choices was recorded. In addition, 
on the eighth trial the models removed 
their hats and hung them in different loca- 
tions in the room. If the child removed his 
hat during the session and placed it along 
side one or the other of the model's hats, 
this imitative act was also scored. 

At the completion of the imitation 
phase of the experiment, the children 
were interviewed by the experimenter in 
order to determine whom they considered 
to be the controller of resources, and to 
assess their model preferences, The latter 
data were used as an index of attraction to 
the models, In addition, for the children 
in the adult consumer condition, the 
session was concluded by providing them 
the same lavish treatment accorded their 
adult rival. 

Children in the control group had no 
prior social interaction with the models 
but participated with them in the imi- 
tative learning phase of the study, The 
experimenter assumed complete charge of 
the procedures and treated the models as 
though they were naive subjects. This 
control group was included primarily to 
determine the models’ relative effective- 
ness as modeling stimuli. In addition, the 
models alternated between subjects in the 
order in which they executed the trials so 
as to test for the possibility of a primacy 
or a recency of exposure effect on imitative 
behavior, 


IMITATION SCORES 


The imitation scores were obtained by 
summing the frequency of occurrence of 
the postural, verbal, and motor responses 
described in the preceding section, and 


the hat, color, and picture preferences that 
matched the selections of each of the two 
models, 

The children’s performances were 
scored by three raters who observed the 
experimental sessions through a one-way 
mirror from an adjoining observation 
room. The raters were provided with a 
separate check list of responses exhibited 
by each of the two models, and the scoring 
procedure simply involved checking the 
imitative responses performed by the chil- 
dren on each trial, In order to provide an 
estimate of interscorer reliability, the per- 
formances of 30% of the children were 
recorded simultaneously but independ- 
ently by two observers. The raters were 
in perfect agreement on 95% of the spe- 
cific imitative responses that they scored. 


Results 


The control group data revealed that 
the two models were equally effective in 
cliciting imitative responses, the mean 
values being 17.83 and 20.46 for the male 
and female model, respectively; nor did 
the children display differential imitation 
of same-sex (M = 22.30) and opposite 
sex (M = 18.50) models, Although chil- 
dren in the control group tended to imi- 
tate the second model (M = 22.21) to a 
somewhat greater extent than the one who 
performed first (M = 16.08) on each 
trial, suggesting a recency of exposure 
effect, the difference was not of statisti- 
cally significant magnitude (t = 1.60). 

Table 1 presents the mean imitation 
scores for children in cach of the two 
experimental triads. A 2 x 2 x 2 x 2 
mixed factorial analysis of variance was 
computed on these data in which the 
four factors in the design were sex of 
child, sex of the model who controlled 
the resources, adult versus child consumer, 
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TABLE I 
Mean Number of imitative Responses Performed by Subgroups 
of Children in the Experimental Triads 


Subjects Male Female Female Male 
Controller Consumer Controller Conme 

Girls 29.00 9.67 26.00 10.00 

Boys 30.17 18.67 22.33 16,17 

total 29.59 14.17 24.17 13.09 
Controller Ignored Controller Ignored 

Girls 22.00 16.17 ELES] 22.17 

Boys 29.17 16.67 26.83 M50 

total 25.59 16,42 29.4 25.4 


From Bandura, Ross and Ross, A comparative test of the status, envy, 
social power, and secondary reinforcement theories of identificatory 


leaming, 


and the controller versus the other model 
as the source of imitative behavior* As 
shown in Table 2, the findings of this 
study clearly support the social power 
theory of imitation, In both experimental 
treatments, regardless of whether the rival 
adult or the children themselves were the 
recipients of the rewarding resources, the 
model who possessed rewarding power was 
imitated to a greater degree than was the 
rival or the ignored model (F = 40.61, 
p <.001). Nor did the condition com- 
bining resource ownership with direct ro 
inforcement of the child yield the highest 
imitation of the model who pa 
and dispensed the positive 

latter finding is particularly surprising 
since an carlier experiment based on two- 


® The assistance of Eleanor Willemen 
with the statistical computations b grate 
fully acknowledged. 
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TABLE 2 
Summary of the Analysis of Variance of the Imitation Scores 


SOURCE df MS F 
Between subjects 47 310.17 
sex of subjects (A) 1 283.59 <l 
sex of controller model (d) 1 128.34 <l 
adult versus child consumer (C) 1 518.01 1.61 
AxB 1 23.01 <1 
AXC 1 1.76 <l 
BxC 1 742.59 2.31 
AXBXC 1 21,10 <l 
error (b) 40 321.49 
Within subjects 48 113.24 
controller versus other model (D) 1 2,025.84 stAT Dais 
AxD 1 297.51 5.96* 
BxD 1 237.51 4.76* 
cxD 1 396.09 ng94e" 
AxXBxD 1 256.76 5al5* 
AxCxD 1 19.52 <l 
BxCxD 1 23.02 <1 
AXBxCxD 1 184.00 3.69 
error (w) 40 49.88 
*p<.05. 
ep ..01, 
***D <.001. 


From Bandura, Ross and Ross, A comparative test of the status, envy, social 
power, and secondary reinforcement theories of identificatory learning. 


doesn’t share much, John played bravely 
even though she didn’t even share... . 
She's a bit greedy.”). 

As a partial check on whether this 
factor would tend to diminish the differ- 
ential imitation of the two models, six 
children—three boys and three girls—par- 
ticipated in a modified Child Consumer 
treatment in which, halfway through the 
social interaction session, the ignored 
adult was informed that he too may have 
access to the playthings. He replied that 
he was quite content to read his book. 
This modified procedure, which removed 
the rivalry and the exclusion of the model, 
yielded four times as much imitation of 


the controller relative to the model who 
was ignored by choice. 

The significant triple interaction effect 
indicates that the differential in the con- 
troller-other model imitation was greatest 
when the same-sex model mediated the 
positive reinforcers, and this effect was 
more pronounced for boys than for girls. 

The data presented so far demonstrate 
that manipulation of rewarding power had 
produced differential imitation of the be- 
havior exhibited by the two models. In 
order to assess whether the dispensing of 
positive reinforcers in the prior social 
interaction influenced the overall level of 
matching responses, the imitation scores 


in each of the three groups were summed 
across models and analyzed using a 
Sex x Treatment design. 

Fhe mean total imitative responses for 
children in the Child Consumer, Adult 
Consumer, and the Control group were 
5 40.58, and 37.88, respectively. 
Analysis of variance of these data reveals 

enificant treatment effect (F = 3.37, 
025 < p < .05). Further comparisons of 
I of means by the t test, show that 
children in the child rewarded condition 
displayed significantly more imitative be- 
havior than did children both in the Adult 
C mer treatment (t = 2.19, p < .05), 
and those in the Control group (t = 2.48, 
p < .02). The Adult Consumer and Con- 
tre oups, however, did not differ from 
each other in this respect (t = .54). 

The model preference patterns were 
identical for children in the two experi- 
mental conditions and consequently, the 
date were combined for the statistical 
analysis. Of the 48 children, 32 selected 
the model who possessed rewarding 
r as the more attractive, while 16 
sed the noncontrolling adult. The 
greater attractiveness of the rewarding 
model was significant beyond the .05 level 
(92 = 5.34). The experimental triad in 
which boys were the recipients of positive 
reinforcers while the male model was ig- 
nored, and the female consumer-girl 
ignored subgroup, contributed the highest 
preference for the noncontrolling adult. 

In addition to the experimental groups 
discussed in the preceding section, data 
are available for 9 children in the Adult 
Consumer condition, and for 11 children 
in the Child Consumer treatment who 
revealed, in their post-experiment inter- 
views, that they had actually attributed 
rewarding power to the ignored or the 
consumer adult despite the elaborate ex- 
perimental manipulations designed to 
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establish differential power status. A 
number of these children were firmly 
convinced that only a male can possess 
resources and, therefore, the female dis- 
pensing the rewards was only an inter- 
mediary for the male model (for example, 
“He's the man and it’s all his because he’s 
a daddy. Mommy never really has things 
belong to her. . . . He’s the daddy so it’s 
his but he shares nice with the mommy. 
. . . He’s the man and the man always 
really has the money and he lets ladies 
play too. John’s good and polite and he 
has very good manners.”). This view of 
resource ownership within the family 
constellation was often directly reinforced 
by the mothers (for example, “My 
mommy told me and Joan that the daddy 
really buys all the things, but the mommy 
looks after things.”). Children who at- 
tributed the resource ownership to the 
consumer or ignored female model had 
considerable difficulty in explaining their 
selection (for example, “I just knowed it 
does. . . . I could tell, that’s how.”), per- 
haps, because the power structure they 
depicted is at variance with the widely 
accepted cultural norm. 

As shown in Table 3, models who were 
attributed rewarding power elicited ap- 
proximately twice as many matching re- 
sponses than models who were perceived 
by the children as possessing no control 
over the rewarding resources. Because of 
the small and unequal number of cases in 
each cell, these data were not evaluated 
statistically. The differences, however, 
are marked and quite in accord with those 
produced by the experimentally manipu- 
lated variations in power status. 


DISCUSSION 


To the extent that the imitative behav- 
ior elicited in the present experiment may 
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TABLE 3 
Imitation as a Function of Attributed Rewarding Power to the Models 


—_—_—_—_—_$_—$ 


OBJECTS OF IMITATION 


Male Female 
TREATMENT Female noncon- Male noncon- 
CONDITION controller troller controller troller 
Adult consumer 24.0 12.3 29.8 14.6 
Child consumer 18.2 6.7 35.5 16.2 


ee 
From Bandura, Ross, and Ross, A comparative test of the status, envy, social 
power, and secondary reinforcement theories of identificatory learning. 


be considered an elementary prototype of 
identification within a nuclear family 
group, the data fail to support the inter- 
pretation of identificatory learning as the 
outcome of a rivalrous interaction be- 
tween the child and the adult who occu- 
pies an envied status in respect to the 
consumption of highly desired resources. 
Children clearly identified with the 
source of rewarding power rather than 
with the competitor for these rewards. 
Moreover, power inversions on the part 
of the male and female models produced 
cross-sex imitation, particularly in girls. 
The differential readiness of boys and girls 
to imitate behavior exhibited by an op- 
posite-sex model are consistent with find- 
ings reported by Brown (1956, 1958) that 
boys show a decided preference for the 
masculine role, whereas, ambivalence and 
masculine role preference are widespread 
among girls. These findings probably re- 
flect both the differential cultural toler- 
ance for cross-sex behavior displayed by 
males and females, and the privileged 
status and relatively greater positive rein- 
forcement of masculine role behavior in 
our society. 

Failure to develop sex appropriate be- 
havior has received considerable attention 


in the clinical literature and has custom- 
arily been assumed to be established 
and maintained by psychosexual threat 
and anxiety reducing mechanisms. Our 
findings strongly suggest, however, that 
external social learning variables, such as 
the distribution of rewarding power 
within the family constellation, may be 
highly influential in the formation of in- 
verted sex role behavior. 

Theories of identificatory learning have 
generally assumed that within the family 
setting the child’s initial identification is 
confined to his mother, and that during 
early childhood boys must turn from the 
mother as the primary model to the father 
as the main source of imitative behavior. 
However, throughout the course of de- 
velopment children are provided with 
ample opportunities to observe the be- 
havior of both parents. The results of the 
present experiment reveal that when chil- 
dren are exposed to multiple models they 
may select one or more of them as the 
primary source of behavior, but rarely re- 
produce all the elements of a single 
model’s repertoire or confine their imita- 
tion to that model. Although the children 
adopted many of the characteristics of 
the model who possessed rewarding power, 
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they also reproduced some of the elements 
of behavior exhibited by the model who 
occupied the subordinate role. Conse- 
quently, the children were not simply 
junior-size replicas of one or the other 
model; rather, they exhibited a relatively 
novel pattern of behavior representing an 
amalgam of elements from both models. 
Moreover, the specific admixture of be- 
havioral elements varied from child to 
child. These findings provide considerable 
evidence for the seemingly paradoxical 
conclusion that imitation can in fact pro- 
duce innovation of social behavior, and 
that within the same family even same- 
sex siblings may exhibit quite different 
response patterns, owing to their having 
selected for imitation different elements 
of their parents’ response repertoires. 

The association of a model with non- 
contingent positive reinforcement tends 
to increase the incidence of imitative be- 
havior in two person groups (Bandura & 
Huston, 1961), whereas the addition of a 
same-sex third person who is denied access 
to desired rewards may provoke in chil- 
dren negative evaluations of the rewarding 
model and thereby decreases his potency 
as a modeling stimulus. These two sets of 
data demonstrate how learning principles 
based on an individual behavior model 
may be subject to strict limitations, since 
the introduction of additional social vari- 
ables into the stimulus complex can pro- 
duce significant changes in the functional 
relationships between relevant variables. 
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chapter yV I I I 


Personality 


Tur FELD of personality abounds with theoretical concepts suggesting 
processes within the individual which account for the individual’s behavior. 
A learning approach, on the other hand, avoids the use of personality terms 
as labels for inferred inner processes which are never observed. A learning 
approach considers personality simply as behavior which is subject to the 
principles of conditioning. This theme will be developed in the papers 
which follow. 

In the first article Skinner discusses some of the contributions made by 
Freud as well as the shortcomings involved in a psychoanalytic approach. 
Skinner considers Freud’s greatest contribution to have been his insistence 
that human behavior is a natural event determined by other natural events— 
rather than as capricious and not subject to scientific study. Skinner also 
indicates that although Freud was interested in the effects of environmental 
occurrences upon later behavior, he posited that the environmental effects 
worked through inferred mental apparatus of various kinds. Psychoanalysis 
thus became more concerned with these internal fictions than with the 
specification of the environmental conditions and the consequent behaviors. 

The next article by Staats is presented as one contemporary example of 
the contention that psychoanalysis focused attention on supposed inner 
determinants of behavior, rather than on observable environmental condi- 
tions. It may be suggested that the conception that focuses the clinical 
practitioner's efforts on speculation concerning unobservable inner causes 
of disturbed behavior has the unfortunate effect of detracting from the 
search for potentially observable and manipulatable environmental deter- 
minants of the behavior. This example concerns a case in which there is 
interest in an “abnormal” behavior as symbolic of some inner process, 
rather than as a behavior which has been shaped by environmental events 
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according to learning principles. The article also suggests in general (1) 
that some of hospitalized psychotics’ abnormal behaviors may be shaped 
in the hospital environment by the conditions of reinforcement in effect 
and (2) that abnormal behaviors could be changed (treated) using rein- 
forcement procedures—both suggestions finding experimental support in 
several studies presented in the next chapter. 

An additional problem of most personality theories seems to be with the 
nature of observations upon which they are based. For the most part, the 
various conceptions are derived from naturalistic observations of the pa- 
tient’s behavior (primarily his verbal behavior) in the clinical interview. 
The next article by Quay indicates why the verbal behavior of the patient 
in the clinical interview cannot be considered to give the personality theo- 
rist information concerning independent variables which have affected the 
patient. The patients’ verbal reports are subject to the conditions of rein- 
forcement in the interview. One of the important bases of psychoanalytic 
theory concerns the individual's early memories (or reports of them). Quay 
shows that this behavior can be manipulated according to reinforcement 
principles, and in a direction which could spuriously corroborate a theory. 

A number of investigators have also become interested in showing that 
significant human behaviors, which are called personality, are subject to the 
principles of learning. In the two examples of such studies to be presented, 
the article by Eriksen and Kuethe commences an experimental analysis of 
repression. This study may be considered to show general principles by 
which verbal responses acquire aversive properties, and, as a consequence, 
assume weaker positions in the individual’s verbal repertoire. These prin- 
ciples also have implications for understanding such behavioral problems as 
rationalization, projection, fantasy, and the like. 

The next study by Staats, Staats, Heard, and Finley treats personality 
traits as behaviors which can be acquired according to the principles of rein- 
forcement. The traits involved in this study are those which are measured 
on standard personality tests based upon factor analytic methods. The inter- 
pretation of factor traits as classes of behavior acquired and maintained 
according to learning principles also contains explanatory value for the 
purely descriptive character of psychometrics. (See also Nuthmann, 1957; 
Oakes and Droge, 1960.) 

The suggestion of this sample of studies and the general learning orienta- 
tion is that the behaviors which have been considered in previous sections 
of the present book, plus the section which is to follow, are all “personality” 
behaviors. In the first section several types of personality behaviors were 
considered in learning terms. This was also true in papers on verbal be- 
havior, communication, problem solving, purpose, attitude learning, and 
social interaction; and the following section indicates similar findings in the 
area of behavior disorders. The implication that all of the behaviors of the 
individual are “personality” is rather strong, as is the suggestion that most 
of these are learned. 
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This conception may be extended into the realm of abnormal behaviors. 
Abnormal personality, as well as normal, may be considered to be behaviors 
which are acquired, at least in part, according to the principles of learning 
(as will be elaborated within the context of treatment in the next section). 
The next article by Ferster directs itself to an analysis of learning conditions 
in early childhood which may result in an abnormal personality or, in our 
terms, abnormal behaviors. 

The abnormal behavior of the autistic child is analyzed in terms of defi- 
cits in the child’s repertoire, lack of stimulus control, inappropriate behav- 
iors, and so on. As such, this article is a good example of a learning 
approach to an aspect of personality. The analysis commences with exami- 
nation of the behavior which is of interest. It then proceeds to explore the 
types of antecedent (learning) conditions which might account for the 
behavior or in this case the lack of behavior. A complete learning theory 
of personality requires many such analyses. Since there are no observations 
of internal “personality” processes, the analysis makes no conjectures re- 
garding such processes. The essential difference in method here is that the 
learning analysis suggests conditions which might be manipulated to pre- 
vent or change the undesirable behavior involved. 


38. 
Critique of Psychoanalytic Concepts and Theories * 


B. F. Skinner 


Freud’s great contribution to Western 
thought has been described as the appli- 
cation of the principle of cause and effect 
to human behavior. Freud demonstrated 
that many features of behavior hitherto 
unexplained—and often dismissed as 
hopelessly complex or obscure—could be 


* From B. F. Skinner, Critique of psycho- 
analytic concepts and theories, The Sci- 
entific Monthly, 79, 300-305 (1954). Re- 
printed by permission of the author and 
The Scientific Monthly. 


shown to be the product of circumstances 
in the history of the individual. Many of 
the casual relationships he so convincingly 
demonstrated had been wholly unsus- 
pected—unsuspected, in particular, by the 
very individuals whose behavior they con- 
trolled. Freud greatly reduced the sphere 
of accident and caprice in our considera- 
tions of human conduct. His achievement 
in this respect appears all the more im- 
pressive when we recall that he was never 
able to appeal to the quantitative proofs 
characteristic of other sciences. He carried 
the day with sheer persuasion—with the 
massing of instances and the delineation 
of surprising parallels and analogies 
among seemingly diverse materials. 

This was not, however, Freud’s own 
view of the matter. At the age of 70 he 
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summed up his achievement in this way 
(1): 


My life has been aimed at one goal only: 
to infer or guess how the mental apparatus 
is constructed and what forces interplay and 
counteract in it. 


It is difficult to describe the mental ap- 
paratus he refers to in noncontroversial 
terms, partly because Freud’s conception 
changed from time to time and partly 
because its very nature encouraged mis- 
interpretation and misunderstanding. But 
it is perhaps not too wide of the mark to 
indicate its principal features as follows: 
Freud conceived of some realm of the 
mind, not necessarily having physical ex- 
tent, but nevertheless capable of topo- 
graphic description and of subdivision into 
regions of the conscious, coconscious, 
and unconscious. Within this space, vari- 
ous mental events—ideas, wishes, memo- 
ties, emotions, instinctive tendencies, and 
so on—interacted and combined in many 
complex ways. Systems of these mental 
events came to be conceived of almost as 
subsidiary personalities and were given 
proper names: the id, the ego, and the 
superego. These systems divided among 
themselves a limited store of psychic en- 
ergy. There were, of course, many other 
details. 

No matter what logicians may eventu- 
ally make of this mental apparatus, there 
is little doubt that Freud accepted it as 
real rather than as a scientific construct 
or theory. One does not at the age of 70 
define the goal of one’s life as the explora- 
tion of an explanatory fiction. Freud did 
not use his “mental apparatus” as a postu- 
late system from which he deduced theo- 
rems to be submitted to empirical check. 
If there was any interaction between the 
mental apparatus and empirical observa- 
tions, it took the form of modifying the 


apparatus to account for newly discove 
facts. To many followers of Freud 
mental apparatus appears to be equally as 
real, and the exploration of such 
paratus is similarly accepted as the goal 
a science of behavior. There is an alterna- 
tive view, however, which holds that 
Freud did not discover the ment 
paratus but rather invented it, borr 
part of its structure from a tradit 
philosophy of human conduct but a 
many novel features of his own devisi 

There are those who will concede | 
Freud’s mental apparatus was a scier 
construct rather than an observable ern 
pirical system but who, nevertheles 
tempt to justify it in the light of sc 
method. One may take the line that me! 
phorical devices are inevitable in the 
stages of any science and that alth 
we may look with amusement today 1 
the “essences,” “forces,” “phlogista: 
and “ethers,” of the science of yesterday, 
these nevertheless were essential to the 
historical process. It would be difficult to 
prove or disprove this. However, if we 
have learned anything about the nature of 
scientific thinking, if mathematical and 
logical researches have improved our ca- 
pacity to represent and analyze empirical 
data, it is possible that we can avoid some 
of the mistakes of adolescence. Whether 
Freud could have done so is past demon- 
strating, but whether we need similar con- 
structs in the future prosecution of a 
science of behavior is a question worth 
considering. 

Constructs are convenient and perhaps 
even necessary in dealing with certain 
complicated subject matters. As Frenkel- 
Brunswik shows (2), Freud was aware of 
the problems of scientific methodology 
and even of the metaphorical nature of 
some of his own constructs. When this 
was the case, he justified the constructs as 
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necessary or at least highly convenient. 
But awareness of the nature of the meta- 
phor is no defense of it, and if modem 
is still occasionally metaphorical, 
e must remember that theory-wise it is 
also still in trouble. The point is not that 
metaphor or construct is objectionable 


but that particular metaphors and con- 
structs have caused trouble and are con- 


ng to do so. Freud recognized the 
amaged worked by his own metaphorical 
thinking, but he felt that it could not be 


avoided and that the damage must be put 
up with. There is reason to disagree with 
him on this point. 

'ud’s explanatory scheme followed a 
traditional pattern of looking for a cause 
of human behavior inside the organism. 
His medical training supplied him with 


powerful supporting analogies. The par- 
allel between the excision of a tumor, for 
example, and the release of a repressed 
from the unconscious is quite com- 
I ig and must have affected Freud’s 
thinking. Now, the pattern of an inner 
explanation of behavior is best exempli- 
ed by doctrines of animism, which are 
imarily concerned with explaining the 
taneity and evident capriciousness of 
navior, The living organism is an ex- 
ely complicated system behaving in 
an extremely complicated way. Much of 
its behavior appears at first blush to be 
absolutely unpredictable. The traditional 
procedure had been to invent an inner 
determiner, a “demon,” “spirit,” “ho- 
munculus,” or “personality” capable of 
spontaneous change of course or of origi- 
nation of action. Such an inner determiner 
offers only a momentary explanation of 
the behavior of the outer organism, be- 
cause it must, of course, be accounted for 
also, but it is commonly used to put the 
matter beyond further inquiry and to 
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bring the study of a causal series of events 
to a dead end. 

Freud, himself, however, did not appeal 
to the inner apparatus to account for 
spontaneity or caprice because he was a 
thoroughgoing determinist. He accepted 
the responsibility of explaining, in turn, 
the behavior of the inner determiner. He 
did this by pointing to hitherto unnoticed 
external causes in the environmental and 
genetic history of the individual. He did 
not, therefore, need the traditional ex- 
planatory system for traditional purposes; 
but he was unable to eliminate the pat- 
tern from his thinking. It led him to rep- 
resent each of the causal relationships he 
had discovered as a series of three events. 
Some environmental condition, very often 
in the early life of the individual, leaves 
an effect upon the inner mental apparatus, 
and this in turn produces the behavioral 
manifestation or symptom. Environmen- 
tal event, mental state or process, behav- 
ioral symptom—these are the three links 
in Freud’s causal chain. He made no ap- 
peal to the middle link to explain spon- 
taneity or caprice. Instead he used it to 
bridge the gap in space and time between 
the events he had proved to be causally 
related. 

A possible alternative, which would 
have had no quarrel with established 
science, would have been to argue that the 
environmental variables leave physiologi- 
cal effects that may be inferred from the 
behavior of the individual, perhaps at a 
much later date. In one sense, too little is 
known at the moment of these physiologi- 
cal processes to make them useful in a 
legitimate way for this purpose. On the 
other hand, too much is known of them, 
at least in a negative way. Enough is 
known of the nervous system to place 
certain dimensional limits upon specula- 


390 Personality 


tion and to clip the wings of explanatory 
fiction. Freud accepted, therefore, the tra- 
ditional fiction of a mental life, avoiding 
an out-and-out dualism by arguing that 
eventually physiological counterparts 
would be discovered. Quite apart from the 
question of the existence of mental events, 
let us observe the damage that resulted 
from this maneuver. 

We may touch only briefly upon two 
classical problems that arise once the 
conception of a mental life has been 
adopted. The first of these is to explain 
how such a life is to be observed. The 
introspective psychologists had already 
tried to solve this problem by arguing that 
introspection is only a special case of the 
observation upon which all science rests 
and that man’s experience necessarily 
stands between him and the physical 
world with which science purports to 
deal. But it was Freud himself who 
pointed out that not all of one’s mental 
life was accessible to direct observation— 
that many events in the mental apparatus 
were necessarily inferred. Great as this dis- 
covery was, it would have been still greater 
if Freud had taken the next step, advo- 
cated a little later by the American move- 
ment called Behaviorism, and insisted that 
conscious, as well as unconscious, events 
were inferences from the facts. By arguing 
that the individual organism simply reacts 
to its environment, rather than to some 
inner experience of that environment, the 
bifurcation of nature into physical and 
psychic can be avoided (3). 

A second classical problem is how the 
mental life can be manipulated. In the 
process of therapy, the analyst necessarily 
acts upon the patient only through physi- 
cal means. He manipulates variables oc- 
cupying a position in the first link of 
Freud’s causal chain. Nevertheless, it is 
commonly assumed that the mental ap- 


paratus is being directly manipulated. 
Sometimes it is argued that processes are 
initiated within the individual himself, 
such as those of free association and 
transference, and that these in turn act 
directly upon the mental apparatus. But 
how are these mental processes initiated 
by physical means? The clarification of 
such a causal connection places a heavy 
and often unwelcome burden of proof 
upon the shoulders of the dualist. 

The important disadvantages of Freud’s 
conception of mental life can be described 
somewhat more specifically. The first of 
these concerns the environmental varia- 
bles to which Freud so convincingly 
pointed. The cogency of these variables 
was frequently missed because the varia- 
bles were transformed and obscured in 
the course of being represented in mental 
life. The physical world of the organism 
was converted into conscious and uncon- 
scious experience, and these experiences 
were further transmuted as they combined 
and changed in mental processes. For ex- 
ample, early punishment of sexual behav- 
ior is an observable fact that undoubtedly 
leaves behind a changed organism. But 
when this change is represented as a state 
of conscious or unconscious anxiety or 
guilt, specific details of the punishment 
are lost. When, in turn, some unusual 
characteristic of the sexual behavior of the 
adult individual is related to the supposed 
guilt, many specific features of the rela- 
tionship may be missed that would have 
been obvious if the same features of be- 
havior had been related to the punishing 
episode. Insofar as the mental life of the 
individual is used as Freud used it to 
represent and to carry an environmental 
history, it is inadequate and misleading. 

Freud’s theory of the mental apparatus 
had an equally damaging effect upon his 
study of behavior as a dependent variable. 
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Inevitably, it stole the show. Little atten- 
tion was left to behavior per se. Behavior 
was relegated to the position of a mere 
mode of expression of the activities of the 
mental apparatus or the symptoms of an 
underlying disturbance. Among the prob- 
lems not specifically treated in the manner 
that was their due, we may note five. 

1) The nature of the act as a unit of 
behavior was never clarified. The simple 
occurrence of behavior was never well 
represented. “Thoughts” could “occur” to 
an individual; he could “have” ideas ac- 
cording to the traditional model; but he 
could “have” behavior only in giving ex- 
pression to these inner events. We are 
much more likely to say that “the thought 
occurred to me to ask him his name” than 
that “the act of asking him his name oc- 
curred to me.” It is in the nature of 
thoughts and ideas that they occur to peo- 
ple, but we have never come to be at 
home in describing the emission of be- 
havior in a comparable way. This is espe- 
cially true of verbal behavior. In spite of 
Freud’s valuable analysis of verbal slips 
and of the techniques of wit and verbal 
art, he rejected the possibility of an anal- 
ysis of verbal behavior in its own right 
rather than as the expression of ideas, 
feelings, or other inner events, and there- 
fore missed the importance of this field 
for the analysis of units of behavior and 
the conditions of their occurrence. 

The behavioral nature of perception 
was also slighted. To see an object as an 
object is not mere passive sensing; it is an 
act, and something very much like it oc- 
curs when we see an object although no 
object is present. Fantasy and dreams were 
for Freud not the perceptual behavior of 
the individual but pictures painted by an 
inner artist in some atelier of the mind 
which the individual then contemplated 
and perhaps then reported. This division 
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of labor is not essential when the behav- 
ioral component of the act of seeing is 
emphasized. 

2) The dimensions of behavior, par- 
ticularly its dynamic properties, were 
never adequately represented. We are all 
familiar with the fact that some of our 
acts are more likely to occur upon a given 
occasion than others. But this likelihood 
is hard to represent and harder to evalu- 
ate. The dynamic changes in behavior 
that are the first concern of the psycho- 
analyst are primarly changes in probability 
of action. But Freud chose to deal with 
this aspect of behavior in other terms—as 
a question of “libido,” “cathexis,” “vol- 
ume of excitation,” “instinctive or emo- 
tional tendencies,” “available quantities 
of psychic energy,” and so on. The deli- 
cate question of how probability of action 
is to be quantified was never answered, 
because these constructs suggested dimen- 
sions to which the quantitative practices 
of science in general could not be applied. 

3) In his emphasis upon the genesis of 
behavior, Freud made extensive use of 
processes of learning. These were never 
treated operationally in terms of changes 
in behavior but rather as the acquisition 
of ideas, feelings, and emotions later to be 
expressed by, or manifested in, behavior. 
Consider, for example, Freud’s own sug- 
gestion that sibling rivalry in his own 
early history played an important part in 
his theoretical considerations as well as in 
his personal relationships as an adult. 

An infant brother died when Freud 
himself was only 114 years old, and as a 
young child Freud played with a boy 
somewhat older than himself and pre- 
sumably more powerful, yet who was, 
strangely enough, in the nominally sub- 
ordinate position of being his nephew. To 
classify such a set of circumstances as 
sibling rivalry obscures, as we have seen, 
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the many specific properties of the cir- 
cumstances themselves regarded as inde- 
pendent variables in a science of behavior. 
To argue that what was learned was the 
effect of these circumstances upon uncon- 
scious or conscious aggressive tendencies 
or feelings of guilt works a similar mis- 
representation of the dependent variable. 
An emphasis upon behavior would lead 
us to inquire into the specific acts plau- 
sibly assumed to be engendered by these 
childhood episodes. In very specific terms, 
how was the behavior of the young Freud 
shaped by the special reinforcing contin- 
gencies arising from the presence of a 
younger child in the family, by the death 
of that child, and by later association 
with an older playmate who nevertheless 
occupied a subordinate family position? 
What did the young Freud learn to do to 
achieve parental attention under these 
difficult circumstances? How did he avoid 
aversive consequences? Did he exaggerate 
any illness? Did he feign illness? Did he 
make a conspicuous display of behavior 
that brought commendation? Was such 
behavior to be found in the field of physi- 
cal prowess or intellectual endeavor? Did 
he learn to engage in behavior that would 
in turn increase the repertoires available 
to him to achieve commendation? Did he 
strike or otherwise injure young children? 
Did he learn to injure them verbally by 
teasing? Was he punished for this, and if 
so, did he discover other forms of be- 
havior that had the same damaging effect 
but were immune to punishment? 

We cannot, of course, adequately an- 
swer questions of this sort at so late a 
date, but they suggest the kind of inquiry 
that would be prompted by a concern for 
the explicit shaping of behavioral reper- 
toires under childhood circumstances. 
What has survived through the years is 
not aggression and guilt, later to be mani- 


fested in behavior, but rather patterns of 
behavior themselves. It is not enough to 
say that this is “all that is meant” by 
sibling rivalry or by its effects upon the 
mental apparatus. Such an expression ob- 
scures, rather than illuminates, the nature 
of the behavioral changes taking place in 
the childhood learning process. A similar 
analysis could be made of processes in the 
fields of motivation and emotion. 

4) An explicit treatment of behavior 
as a datum, of probability of response as 
the principal quantifiable property of be- 
havior, and of learning and other processes 
in terms of changes of probability is usu- 
ally enough to avoid another pitfall into 
which Freud, in common with his con- 
temporaries, fell. There are many words 
in the layman’s vocabulary that suggest 
the activity of an organism yet are not 
descriptive of behavior in the narrower 
sense. Freud used many of these freely— 
for example, the individual is said to dis- 
criminate, remember, infer, repress, de- 
cide, and so on. Such terms do not refer 
to specific acts. We say that a man dis- 
criminates between two objects when he 
behaves differently with respect to them; 
but discriminating is not itself behavior. 
We say that he represses behavior which 
has been punished when he engages in 
other behavior just because it displaces 
the punished behavior; but repressing is 
not action. We say that he decides upon 
a course of conduct either when he enters 
upon one course to the exclusion of an- 
other, or when he alters some of the vari- 
ables affecting his own behavior in order 
to bring this about; but there is no other 
“act of deciding.” The difficulty is that 
when one uses terms which suggest an 
activity, one feels it necessary to invent an 
actor, and the subordinate personalities 
in the Freudian mental apparatus do, in- 
deed, participate in just these activities 
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rather than in the more specific behavior 
of the observable organism. 

Among these activities are conspicuous 
instances involving the process of self- 
control—the so-called “Freudian mecha- 
nisms.” These need not be regarded as 
activities of the individual or any sub- 
division thereof—they are not, for ex- 
ample, what happens when a skillful wish 
evades a censor—but simply as ways of 
representing relationships among re- 
sponses and controlling variables. I have 
elsewhere tried to demonstrate this by 
restating the Freudian mechanisms with- 
out reference to Freudian theory (4). 

5) Since Freud never developed a clear 
conception of the behavior of the or- 
ganism and never approached many of the 
scientific problems peculiar to that sub- 
ject matter, it is not surprising that he 
misinterpreted the nature of the observa- 
tion of one’s own behavior. This is ad- 
mittedly a delicate subject, which presents 
problems which no one, perhaps, has ade- 
quately solved. But the act of self-observa- 
tion can be represented within the frame- 
work of physical science. This involves 
questioning the reality of sensations, ideas, 
feelings, and other states of consciousness 
which many people regard as among the 
most immediate experiences of their life. 
Freud himself prepared us for this change. 
There is, perhaps, no experience more 
powerful than that which the mystic re- 
ports of his awareness of the presence of 
God. The psychoanalyst explains this in 
other ways. He himself, however, may 
insist upon the reality of certain experi- 
ences that others wish to question. There 
are other ways of describing what is actu- 
ally seen or felt under such circumstances. 

Each of us is in particularly close con- 
tact with a small part of the universe 
enclosed within his own skin. Under cer- 
tain limited circumstances, we may come 
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to react to that part of the universe in 
unusual ways. But it does not follow that 
that particular part has any special physi- 
cal or nonphysical properties or that our 
observations of it differ in any fundamen- 
tal respect from our observations of the 
rest of the world. I have tried to show 
elsewhere (4) how self-knowledge of this 
sort arises and why it is likely to be subject 
to limitations that are troublesome from 
the point of view of physical science. 
Freud’s representations of these events 
was a particular personal contribution in- 
fluenced by his own cultural history. It 
is possible that science can now move on 
to a different description of them. If it is 
impossible to be wholly nonmetaphorical, 
at least we may improve upon our meta- 
phors. 

The crucial issue here is the Freudian 
distinction between the conscious and un- 
conscious mind. Freud’s contribution has 
been widely misunderstood. ‘The impor- 
tant point was not that the individual was 
often unable to describe important as- 
pects of his own behavior or identify im- 
portant causal relationships but that his 
ability to describe them was irrelevant to 
the occurrence of the behavior or to the 
effectiveness of the causes. We begin by 
attributing the behavior of the individual 
to events in his genetic and environmen- 
tal history. We then note that because of 
certain cultural practices, the individual 
may come to describe some of that be- 
havior and some of those causal relation- 
ships. We may say that he is conscious of 
the parts he can describe and unconscious 
of the rest. But the act of self-description, 
as of self-observation, plays no part in the 
determination of action. It is superim- 
posed upon behavior. Freud's argument 
that we need not be aware of important 
causes of conduct leads naturally to the 
broader conclusion that awareness of 
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cause has nothing to do with causal effec- 
tiveness. 

In addition to these specific conse- 
quences of Freud’s mental apparatus in 
obscuring important details among the 
variables of which human behavior is a 
function and in leading to the neglect of 
important problems in the analysis of be- 
havior as a primary datum, we have to 
note the most unfortunate effect of all. 
Freud’s methodological strategy has pre- 
vented the incorporation of psychoanaly- 
sis into the body of science proper. It was 
inherent in the nature of such an explana- 
tory system that its key entities would be 
unquantifiable in the sense in which en- 
tities in science are generally quantifiable, 
but the spatial and temporal dimensions 
of these entities have caused other kinds 
of trouble. 

One can sense a certain embarrassment 
among psychoanalytic writers with respect 
to the primary entities of the mental 
apparatus. There is a predilection for 
terms that avoid the embarrassing ques- 
tion of the spatial dimensions, physical or 
otherwise, of terms at the primary level. 
Although it is occasionally necessary to 
refer to mental events and their qualities 
and to states of consciousness, the analyst 
usually moves on in some haste to less 
committal terms such as forces, processes, 
organizations, tensions, systems, and 
mechanisms. But all these imply terms at 
a lower level. The notion of a conscious or 
unconscious “force” may be a useful met- 
aphor, but if this is analogous to force in 
physics, what is the analogous mass that 
is analogously accelerated? Human behav- 
ior is in a state of flux and undergoing 
changes that we call “processes,” but 
what is changing in what direction when 
we speak of, for example, an affective 
process? Psychological “organizations,” 
“mental systems,” “motivational interac- 


tion’—these all imply arrangements or 
relationships among things, but what are 
the things so related or arranged? Until 
this question has been answered the prob- 
lem of the dimensions of the mental ap- 
paratus can scarcely be approached. It is 
not likely that the problem can be solved 
by working out independent units ap- 
propriate to the mental apparatus, al- 
though it has been proposed to undertake 
such a step in attempting to place psycho- 
analysis on a scientific footing. 

Before one attempts to work out units 
of transference or scales of anxiety, or 
systems of mensuration appropriate to the 
regions of consciousness, it is worth asking 
whether there is not an alternative pro- 
gram for a rapprochement with physical 
science that would make such a task un- 
necessary. Freud could hope for an even- 
tual union with physics or physiology only 
through the discovery of neurological 
mechanisms that would be the analogs of, 
or possibly only other aspects of, the 
features of his mental apparatus. Since 
this depended upon the prosecution of a 
science of neurology far beyond its current 
state of knowledge, it was not an attrac- 
tive future. Freud appears never to have 
considered the possibility of bringing the 
concepts and theories of a psychological 
science into contact with the rest of physi- 
cal and biological science by the simple 
expedient of an operational definition of 
terms. This would have placed the mental 
apparatus in jeopardy as a life goal, but it 
would have brought him back to the ob- 
servable, manipulable, and preeminently 
physical variables with which he was in 
the last analysis dealing. 
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39. 
Learning Theory and “Opposite Speech” * 


Arthur W. Staats 


Laffal, Lenkoski, and Ameen (4), have 
recently reported the case of a schizo- 
phrenic patient demonstrating what they 
call an “opposite speech” syndrome. The 
authors state that the syndrome is basi- 
cally a reversal in certain language usages, 
especially in the use of “yes” and “no.” 
Feeling that the speech reversal is an ex- 
pression of repressed hostility, they sug- 
gest that opposite speech copes with the 
hostile impulses by disrupting communi- 
cation and rejecting other people or by 
allowing the “verbalization of ideas which 
the patient consciously rejects” (4, p. 
412) 

Laffal et al. conclude that learning the- 


* From A. W. Staats, Learning theory and 
“opposite speech,” J. abnorm. soc. Psy- 
chol., 55, 268-269 (1957). Reprinted by 
permission of the author and the American 
Psychological Association. 


ory has little to offer in this instance or 
others of pathological speech “. . . [T]he 
so-called pragmatic and interpersonal 
functions of language behavior have been 
largely neglected by learning theorists in 
favor of the meaning or semantic aspects” 
(4, p. 412). 

However, a number of recent experi- 
mental and theoretical studies (such as 1, 
2, 3, 5, 6, 7, 9, 10) have been very much 
concerned with similar problems of lan- 
guage behavior. Several points can thus be 
made from a learning theory approach 
which have relevance for “opposite 
speech.” Skinner, for example, generally 
defines verbal behavior as “behavior 
which is reinforced through the media- 
tion of another organism” (7, p. 20). In- 
stead of asking, as do Laffal et al., “what 
uses [needs] the opposite speech may 
serve” (4, p. 412), reinforcement theory 
is concerned with the conditions which 
increase the probability that the response 
will occur again in similar stimulus situa- 
tions or which strengthen the response. 

It has been shown experimentally (1, 
3, 9, 10) that social reinforcement which 
follows verbal responses has the effect of 
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increasing their frequency. These studies 
have used various social reinforcements. 
The question is thus raised regarding the 
reinforcements involved in opposite 
speech. One possibility may be taken from 
a discussion of generalized reinforcers by 
Skinner. 


The child who misbehaves “just to get 
attention” is familiar. The attention of peo- 
ple is reinforcing because it is a necessary 
condition for other reinforcements from 
them. . . . The attention of someone who 
is particularly likely to supply reinforcement 
—a parent, a teacher, or a loved one—is an 
especially good generalized reinforcer and 
sets up especially strong attention-getting 
behavior (8, p. 78). 


It is suggested that attention, operating 
as a generalized reinforcer, could account 
in part for the origin and maintenance of 
opposite speech. The interview quoted by 
Laffal (4, p. 411) is a good demonstration 
of how the patient’s opposite speech could 
elicit attention from others. Other rein- 
forcers would also be effective in strength- 
ening reversed language. For example, the 
patient’s reversals were said to “not extend 
to . . . thought or action. Thus, if asked 
if he wishes a cigaret, the patient may say, 
‘No’ instead of ‘Yes, I do,’ but he accepts 
and smokes the cigaret” (4, p. 412). Giv- 
ing the cigaret to the “No” response is a 
reinforcement and would be expected to 
strengthen that response, i.e. raise the 
probability that the patient would again 
say “No” in the same situation. Reinforce- 
ments such as these, without concomitant 
admonition, would be unlikely to occur 
in the normal person’s social environment. 

Certain implications are derivable from 
this interpretation. If the opposite speech 
is maintained by positive reinforcement, 
then lack of such reinforcement should 
lead to extinction of such behavior. For 
example, withholding the cigaret should 


weaken the strength of opposite speech, 
and giving the cigaret to correct speech 
should strengthen that type of response, 

Another example of learning theory 
formulations applicable to opposite speech 
is offered by Dollard and Miller (2). ‘They 
discuss repression in terms of reinforce- 
ment theory. Certain thoughts arouse 
anxiety. Cessation of thinking those 
thoughts reduces anxiety. Thus, stopping 
thinking about that topic becomes a well- 
learned response. The same analysis can 
be applied to speech. Dollard and Miller 
(2) give an example of a group of people 
who change the topic of a conversation 
because it arouses anxiety, and state, “peo- 
ple tend to learn to avoid unpleasant 
topics of conversation” (2, p. 199). 

It could be said that the schizophrenic 
patient’s verbal behavior, when it is not 
confused by reversal, elicits an anxiety 
response in him, perhaps because of its 
typical content. Confused ways of speak- 
ing, and perhaps even of thinking, would 
therefore be anxiety reducing. This ra- 
tionale could be extended to obsessive 
thinking in addition to other types of 
confused schizophrenic speech and 
thought. In addition, for the schizo- 
phrenic, communication with others 
which is understandable probably intro- 
duces touchy subjects which arouse anxi- 
ety. Reversed verbal behavior and other 
confused speech may reduce anxiety when 
it produces breakdown of the communi- 
cation and cessation of the anxiety pro- 
ducing subject matter or of the bother- 
some conversation itself. 

Why the schizophrenic’s speech might 
elicit anxiety in him need not herein be 
elaborated, since the speech symptom is 
the relevant topic. It could be stated, how- 
ever, that the unhappy life situation of an 
adult schizophrenic probably elicits 
thought and speech which are not positive 
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secondary reinforcers, but instead arouse 
anxiety. It is also probable that the lack 
of success of the schizophrenic’s life be- 
havior evokes verbal behavior from others 
which is anxiety producing for the schizo- 
phrenic. Verbal and nonverbal behavior 
of the schizophrenic which would avoid 
this anxiety would thus be well learned. 

In concluding, it should be stated that 
this note is not intended as a complete 
analysis of the opposite speech of the 
schizophrenic patient. Perhaps it points 
out that hypotheses which apply to patho- 
logical language can be derived from a 
learning theory approach. At any rate, it 
is suggested that learning theory has 
reached a state where it has something to 
offer clinical theory and practice. The 
complex activities to which contemporary 
learning theory addresses itself, and not 
without success, indicate that the ap- 
proach can no longer be ignored. 
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40. 
The Effect of Verbal Reinforcement 
on the Recall of Early Memories*’ 


Herbert Quay 


Most present-day theories of human 
personality and of the historical and 
dynamic causes of human behavior were 
originally formulated by individuals prac- 
ticing psychotherapy. In fact, it was the 
memories and free associations of neu- 
totic patients that led Freud to formulate 
his theory of psychosexual development. 
Similarly, the memories and free associa- 
tions of patients talking to other such in- 
novators have led to very different con- 
ceptions of the origins of human person- 
ality. Even though these personality 
theorists presumably began with the same 
raw verbal materials, however, it is ap- 


* From H. Quay, The effect of verbal rein- 
forcement on the recall of early memories, 
J. abnorm. soc. Psychol, 59, 254-257 
(1959). Reprinted by permission of the 
author and the American Psychological 
Association. 

1 An abstract of a Ph.D. thesis done at 
the University of Illinois under the direc- 
tion of J. McV. Hunt. The author wishes 
to express his appreciation to J. McV. 
Hunt, Lee J. Cronbach, G. R. Grice, L. A. 
Hellmer, D. R. Peterson, and M. M. Ohl- 
sen, members of his doctoral committee. 


parent that they derived quite different 
formulations of human motives and con- 
flicts. Moreover, the various schools have 
defended their positions mainly on the 
basis of further psychotherapeutic con- 
tacts with patients, with no resolution of 
the theoretical differences. One may sus- 
pect, therefore, that observations which 
are highly stimulating in the formation 
of hypotheses may not be very useful in 
their verification or testing (Hunt, 1952). 

Logical analysis makes it evident that 
if psychoanalytical therapy, or any other 
form of psychotherapy, is to serve the 
hypothesis-testing as well as the hypothe- 
sis-finding role, it is absolutely necessary 
to assume that the verbal productions of 
patients are free of influence from the 
therapist. Suspicions that the psycho- 
therapist, however unintentionally, does 
influence subtly the productions of his 
patients have already been voiced. Bach 
(1952) observed that the human figure 
drawings produced by his patients during 
psychotherapy were different in their con- 
tent from those produced by patients of 
his psychoanalyst officemate. Further- 
more, the differences appeared in the way 
the content reflected the theoretical 
biases of each therapist. Heine (1953) 
studied patients who had successfully 
completed psychotherapy with therapists 
of different theoretical orientations. He 
found that the reasons given by patients 
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for their improvement corresponded to 
the theoretical convictions of their thera- 
pists about what is therapeutic. 

The recent literature on the operant 
conditioning of verbal behavior may pro- 
vide a paradigm to account for these 
subtle influences. Stemming from the 
work of Greenspoon (1951, 1955), Ver- 
planck (1955a, 1955b), and Wilson and 
Verplanck (1956), a rather wide variety 
of verbal behavior has shown itself sub- 
ject to manipulation by another person 
through the use of verbal reinforcing 
stimuli. From the increase in the proba- 
bility of saying words of certain classes 
(Greenspoon: 1951, 1955; Sidowski, 1954; 
Wilson & Verplanck, 1956) through the 
increase in complex types of discourse 
(Verplanck, 1955a), a wide variety of 
verbal behavior has been manipulated by 
the use of reinforcing stimuli with the 
added finding that subjects (Ss) are gen- 
erally unaware that their behavior has 
been manipulated. No study to date, how- 
ever, has demonstrated that highly per- 
sonal, emotionally charged verbalizations 
are subject to manipulation when the 
participation of the experimenter (E) is 
minimal. Since these are the types of 
verbal productions important in psycho- 
therapy, it is necessary, for the argument 
presented here, to show that such verbal 
responses are subject to the effect re- 
ported for more impersonal materials. 

The hypothesis tested in this study is 
that a verbal reinforcing stimulus in- 
creases the frequency of certain types of 
early childhood memories over their fre- 
quency in a “free-operant” period before 
any reinforcement is applied. 


Method 


The method of this study was to have 
a number of college students report 
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memories of their early childhood. After 
a baseline was established in a “free- 
operant” period, verbal reinforcement at 
a minimal level, the interviewer saying 
“uh-huh,” was introduced to reinforce 
selected memory topics. 


SupjEcts 


Ss were chosen from a large class of 
undergraduates in introductory psychol- 
ogy at the University of Illinois, where 
each student is required to serve for five 
hours as S of psychological experimenta- 
tion. Ss for this study volunteered for an 
experiment presented as involving the re- 
call of childhood events. 

The experimental groups were com- 
posed of 16 Ss in a group for which 
memories concerned with their families 
were reinforced (“family” group—nine 
females and seven males) and 18 Ss in a 
group for which memories concerned with 
people and events outside the family were 
reinforced (‘“nonfamily” group—ten fe- 
males and eight males) . 

The “family” and “nonfamily” classes 
of memories were chosen because they 
could be identified reliably and could pro- 
vide adequate initial operant levels to in- 
sure an early appearance of the operant 
response in the reinforcement period. In- 
structions for scoring, with examples, may 
be found in Quay, 1958. 

The reinforcing stimulus chosen was a 
flat, noncommittal “uh-huh,” spoken in a 
low conversational tone. Such minimal re- 
inforcement was chosen because it is in 
keeping with a general psychotherapeutic 
type of response and because if a response 
this minimal could influence verbal be- 
havior, then almost any remark of a psy- 
chotherapist would be reinforcing. 

All Ss reported for the experiment to 
E’s office at the Psychological Clinic. Ss 
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were instructed to recall events from their 
early childhood as they came to mind. Ss 
were seated in a comfortable chair facing 
away from E. All responses were tape 
recorded by means of a microphone given 
to each S at the time he received his in- 
structions. 

The experimental period was divided 
into two half-hour sessions, generally one 
week apart. The first 10 min. of the first 
half-hour were used to establish the oper- 
ant level (relative frequency) of the cate- 
gory subsequently to be reinforced. This 
procedure served to make each S his own 
control. At the end of the first half-hour, 
S was interrupted and asked to return one 
week later for another half-hour. At the 
end of the second and final half-hour, Ss 
were asked to cooperate further by filling 
out a questionnaire to be sent to them at 
a later date. 

The questionnaire was designed to eli- 
cit information about the degree of S’s 
awareness of the contingency between his 
memories and the reinforcing stimulus. 
While it may have been more informative 
to question each S verbally at the end of 
the final half-hour, this was not done for 
fear that the real purpose of the study 
might become known to Ss who had not 
yet participated. After all Ss had com- 
pleted the experiment, the questionnaire 
was mailed to each with a covering letter. 


Results 
RELIABILITY OF MEMORY CATEGORIES 


The reliability of the classification of 
memories by E when tested by a second 
judge showed a percentage of agreement 
that ranged between 90% and 100%, with 
a mean of 96%. The reliability was based 
upon a tape-recorded sample of 20 memo- 
ries from each of 11 Ss taken as every 


third S from the combined groups. Rein- 
forcements were eliminated from this tape 
to avoid presenting clues to the second 
judge. 


COMPARISON OF OPERANT AND 
REINFORCEMENT PERIODS 


To test the hypothesis that the rein- 
forcing stimulus would increase the pro- 
portion of memories in the reinforced 
category, “family” or “nonfamily,” the 
relative frequency in the operant period 
was compared fo the relative frequency 
in the reinforcement period. This latter 
period was defined as that part of the total 
experimental hour which followed the 
delivery of the second reinforcement. 
Table 1 presents the relative frequency of 
the reinforced category (reinforced mem- 
ories divided by all memories) for the 
operant period and for the reinforcement 
period of each S. 

For the “family” group, 13 of the 16 Ss 
gave a higher proportion of “family” 
memories after reinforcement. The exact 
probability of this result for a one-tailed 
sign test is .01064 (Siegel, 1956). The use 
of a one-tailed test is appropriate, since 
the direction of the change is predicted. 
For the “nonfamily” group, 15 of 18 Ss 
gave a higher proportion of “nonfamily” 
memories after reinforcement. This result 
has an exact probability of .00377 for a 
one-tailed sign test. 

For the groups combined, a technique 
suggested by Cronbach (1949, p. 411) 
was employed. For both groups, the rela- 
tive frequency of “family” memories in 
the reinforcement period was plotted as 
a function of the relative frequency of 
“family” memories in the operant period. 
A median was obtained visually for each 
operant level class interval along the base- 
line and cases in each group falling above 
and below this median were noted. With 
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TABLE 1 
Relative Frequency of Memories in the Reinforced Category 
for the Operant Period and for the Reinforcement Period 
for the Two Experimental Groups 
: “FAMILY” GROUP “NONFAMILY” GROUP 
Rein. Rein- 
Oper force- Oper- force- 

S ant ment Change S ant ment Change 
1 30 43 EA] 1 30 Ay. PA 
2 -39 41 +.02 2 S1; 32 Fa 
3 37 29 —.08 3 81 89 +.08 
4 40 48 +.08 a -78 80 +.02 
5 25 12 it) 5 60 70 +.10 
6 55 58 +.03 6 59 84 ace)! 
7 50 56 +.06 7 90 73 SH 
8 .06 26 +.20 8 60 63 +.03 
9 .60 70 +.10 9 69 70 +.01 
10 50 46 +.04 10 58 64 +.06 
11 50 62 +.12 11 63 70 +.07 
12 33 47 +14: 12 35 58 P23 
13 53 62 +.08 13 50 58 +.08 
14 53 70 +.17 14 55 80 +.25 
15 -38 43 +.05 15 45 61 +.16 
16 .33 48 +.15 16 A8 54 +.06 
17 18 33 +.15 
18 58 57 —.01 


From Quay: The effect of verbal reinforcement on the recall of early memories. 


these above and below the median counts 
combined into a single fourfold table (as 
if the count had been made in terms of a 
grand median for all cases regardless of 
operant level), chi square was computed. 
The obtained value was 12.44, significant 
at the .001 level for one degree of free- 
dom. Inspection of the scatter plot and 
the fourfold table indicated that it was 
cases in the “family” group which more 
often were above the column medians. 
Here it should be noted that while both 
groups are experimental groups, the mu- 
tually exclusive, all-inclusive nature of the 
memory categories makes them at the 
same time control groups for each other. 


For example, if one should argue that the 
relative frequency of “family” memories 
would naturally rise as a result of S be- 
coming more at ease with E as the inter- 
view proceeded, then one must explain 
the drop in relative frequency of “family” 
memories when “nonfamily” memories 
were reinforced. 


Macnrruve or EFFECT 


Inspection of Table 1 indicates further 
that there were differences in amount of 
change for those Ss who showed an in- 
crease in relative frequency of the rein- 
forced category. Increases ranged from .01 
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to .31. Since initial operant levels were 
different for most all of the Ss, no exact 
comparisons of these changes are possible. 
However, no significant Mann-Whitney 
U tests (Siegel, 1956) suggest that these 
differences are unrelated to either “fam- 
ily” or “nonfamily” group or to initial 
operant level. 


AWARENESS OF SUBJECTS 


Of the 30 Ss who returned the ques- 
tionnaire regarding awareness, only one 
individual indicated that he was aware of 
the contingency between his responses 
and the reinforcing stimulus. This S 
ranked second in the magnitude of in- 
crease in relative frequency under rein- 
forcement. Fifteen of the Ss indicated 
that they recognized that E had said 
“uh-huh,” yet all 15 denied having been 
influenced by E. Three Ss indicated that 
E seemed more interested in some topics 
than others; but none named the topic, 
and all three denied influence. Eleven of 
the Ss apparently had no awareness what- 
soever of either E’s saying “uh-huh” or of 
any relationship between this and what 
they recalled. 


DISCUSSION 


This study has demonstrated that 
highly personal and emotionally charged 
memories can be manipulated by another 
person in an interview with very minimal 
verbal participation selectively placed 
after certain classes of these memories. 

While this process of subtle interper- 
sonal influence has not been demon- 
strated within psychotherapy itself, sev- 
eral considerations lead one to predict 
that the effect would appear with even 
greater magnitude over a series of psycho- 
therapeutic interviews. For example, a 


psychotherapist would have much more 
time in which to respond selectively, his 
verbal participation in psychotherapy 
would be considerably greater than the 
very minimal reinforcing verbalization 
used in this study, and it seems very 
likely that he would have more prestige 
(Verplanck, 1955b) with his patients 
than the graduate-student investigator in 
the role of E had with the Ss in this 
experiment. 

Certain implications for the evaluation 
of psychotherapeutic success or failure are 
also suggested by the results of this study. 
One major point of emphasis in the eval- 
uation of patient improvement has been 
the changes in the patient’s verbal behav- 
ior over the course of treatment (Mowrer, 
Hunt, & Kogan, 1953; Raimy, 1948; See- 
man, 1949). While such changes are as- 
sumed to be attributable to a restructur- 
ing of the personality as a result of insights 
gained in the psychotherapy, there cer- 
tainly exists the possibility that a psycho- 
therapist may selectively reinforce these 
types of statements, increasing their fre- 
quency in the later stages of treatment. It 
is conceivable, however, that such changes 
of verbalization may constitute genuine 
therapeutic restructuring, but the validity 
of such a contention must be tested be- 
fore it can be accepted. 

The question of awareness is an intrigu- 
ing one in relation to both the patient and 
the therapist. Many Ss are able to learn 
in the verbal conditioning situation with- 
out verbalizable awareness of either the 
presence of the reinforcing stimulus, the 
response considered “correct,” or the con- 
tingency between the two. That the thera- 
pist may selectively respond outside of his 
own awareness has already been suggested 
by Bach (1952). If research within psy- 
chotherapy itself demonstrates selective 
therapist reinforcement of patient ver 
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balizations which make these verbaliza- 
tions conform more and more to the 
therapist's theoretical convictions, one 
might well expect that this process was 
taking place outside the awareness of both 
patient and therapist. 


SUMMARY 


Thirty-four college students were asked 
to recall events from their early child- 
hood. After a baseline was established in 
an initial operant period, 16 of the Ss 
were reinforced by E saying “uh-huh” 
for memories concerned with members 
of the S’s family. Eighteen of the Ss were 
similarly reinforced for memories not con- 
cerned with the family. In both groups 
the reinforcing stimulus served to in- 
crease the proportion of memories in the 
reinforced category when the reinforce- 
ment period was compared to the operant 
period. The results, indicating that per- 
sonally relevant and emotionally charged 
materials are subject to manipulation by 
the use of a minimal reinforcing verbaliza- 
tion, were related to the testing of causal 
and dynamic hypotheses about personality 
within the psychotherapeutic interview. 
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Zo 
Avoidance Conditioning of Verbal Behavior 
without Awareness: A Paradigm of Repression*' 


Charles W. Eriksen? and 
James L. Kuethe 


Several recent experiments have sug- 
gested that the principles of learning 
theory may be profitably applied to the 
study of language and verbal behavior 
(2, 4, 6). These studies have shown that 
the verbal behavior of a subject can be 
manipulated through the use of differ- 
ential reinforcement and in many cases 
the subjects remain unaware that their be- 
havior has been modified, i.e., they are 
unable to state in what way their behavior 
has changed or even that it has changed. 
While these experiments have dealt with 
overt verbal behavior, it seems reasonable 
that implicit verbal behavior or thinking 
might similarly be affected. If so, these 


* From C. W. Eriksen and J. L. Kuethe, 
Avoidance conditioning of verbal behavior 
without awareness: a paradigm of repres- 
sion, J. abnorm. soc, Psychol., 53, 203-209 
(1956). Reprinted by permission of the 
authors and the American Psychological 
Association. 

1This research was sponsored by Re- 
search Grant M-1037 from the National 
Institute of Mental Health. 

2 Now at the University of Illinois. 


experiments have some interesting impli- 
cations for research on psychological de- 
fense mechanisms in that they offer sug- 
gestions as to how defenses might be 
learned and how they might operate. 

It is an empirical observation that re- 
sponses followed by punishment or anxi- 
ety tend to be eliminated or replaced by 
other responses. If thoughts or implicit 
verbal behavior are considered as re- 
sponses subject to manipulation by rein- 
forcement, we can expect that thoughts 
that have become conditioned stimuli for 
anxiety will be eliminated or replaced by 
other thoughts. Dollard and Miller (3) 
have presented a detailed theoretical 
treatment of defense mechanisms along 
these lines. 

Such a theoretical account of the learn- 
ing of defense mechanisms would gain 
support if it could be shown that thoughts 
or associations that were followed by 
anxiety were eliminated or replaced. It 
was our purpose in the present study to 
determine, first, whether verbal associa- 
tions could be produced without the S’s 
becoming aware that his behavior had 
been modified. We also wished to deter- 
mine if such effects would persist when 
the experimental task was changed. 


Method 


The basic technique used in this study 
was a modified form of the word associa- 
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tion test. Here the same set of stimulus 
words was administered to Ss a number 
of times in an unbroken sequence. Table 
1 shows the 15 stimulus words comprising 
the association list that was used. It was 
assumed that each word on this list con- 
stituted a stimulus having a hierarchy of 
associations or responses that had been 
acquired by S during his life experiences. 
From a pilot study we had found that 
when the same word list is repeated a 
number of times, Ss tend to continue to 
repeat their original associations. We 
wished to determine whether strong elec- 
tric shocks administered every time cer- 
tain selected associations occurred would 
result in these responses dropping out and 
being replaced by other associations. 


TABLE 1 


STIMULUS WORDS 


Careless Lovely 
Perfect’ Hasty 
Cheerful Gawky 
Tidy Rural 
Rotten Thrifty 
Costly Old 
Small Boastful 
Polite 


ee 
From Eriksen and Kuethe: Avoidance condition- 
ing of verbal behavior without awareness: A 
paradigm of repression. 


Prior to beginning the experimental 
sessions with an S, the E randomly desig- 
nated five of the stimulus words in the 
list which were to be the critical stimuli 
for this particular S. During the first trial 
the S’s associations to these five words, 
whatever they happened to be, were pun- 
ished by a strong electric shock. Without 
pause the S was given a second trial on the 
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15 stimulus words followed by a third trial 
and so on for a total of ten trials or until 
the S had reached a criterion of two suc- 
cessive trials without the occurrence of 
any one of the five punished associations. 
On each trial the stimulus words occurred 
in a different sequence. During these suc- 
ceeding trials on the list, S was admin- 
istered a strong electric shock every time 
he responded with one of the five associa- 
tions that had been shocked on the first 
trial. Shocks were administered only when 
these “taboo” associations occurred. 

Shocks were administered through 
ankle electrodes attached to the S’s left 
ankle, The source of the shock came from 
an inductorium and a 3 v.d.c. source. 
Faradic stimulation was used. The inten- 
sity of shocks varied slightly between Ss 
due to such factors as differences in skin 
resistance, but in all cases it was evident 
from the S’s comments and behavior that 
the shocks were quite painful. 

In order to maximize the opportunities 
for obtaining “learning without aware- 
ness,” the Ss were misinformed as to the 
nature of the experiment and the reason 
for the electric shocks. They were told 
that the purpose of the experiment was 
to determine the maximum speed of men- 
tal associations. They were instructed that 
shocks would occur under two conditions: 
one, if their association to a stimulus 
word was too slow for that particular 
stage of practice; and the second was a 
condition that the E could not divulge to 
them in advance, but they might discover 
it on their own during the session and 
thus be able to avoid getting the shocks. 

The Ss were instructed to respond to 
each stimulus word with the first word 
that came to mind and as quickly as pos- 
sible. To insure that they understood the 
nature of the task, several practice words 
were administered. They were also in- 
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formed that the same list of words would 
be repeated over and over, but each time 
the words would occur in a different se- 
quence. During the experimental session 
S’s association time to each stimulus word 
was measured to the nearest hundredth of 
a second by means of an electronic voice 
key. The timer was started by the sound 
of E’s voice and manually stopped by E 
when S responded. 

At the conclusion of this learning phase 
of the experiment, Ss were informed that 
this experiment was over and were then 
asked to do one more task before leaving. 
This consisted of chained associations to 
the stimulus words. The Ss were told that 
the same stimulus words would be re- 
peated again, but this time they were to 
say all the words that came to mind and 
continue doing so until the E said “stop.” 
Fifteen seconds were allowed for chained 
associations to each stimulus word. Before 
starting this phase of the experiment, Ss 
were all carefully instructed that there 
would be no further electric shocks. 

In carrying out the chained associations 
in this experiment, we were interested in 
two things. First, we wished to see if the 
punished association would occur when 
the S was required to give a large number 
of responses, and second, we were inter- 
ested in determining if the effects of 
punishment would be generalized to a 
situation somewhat different from the 
original learning situation, in which the 
threat of shocks had been removed. 

At the conclusion of the chained asso- 
ciations the S was closely interviewed to 
determine his ability to verbalize the true 
nature of the experiment and changes in 
his behavior. All Ss were asked the fol- 
lowing questions: Did you discover how 
to avoid getting shocks? Did you do any- 
thing to keep from getting shocked? 
What did you do? Did you ever find 


yourself withholding a response word and 
trying to think of something else to say? 
(If a positive answer was obtained, S was 
asked if he could recall any instances 
where this occurred.) Those Ss who re- 
ported deliberately withholding responses 
and substituting other responses for them 
were also questioned as to whether they 
had to continue doing this throughout 
the experiment. 

In addition to the questioning, Ss were 
shown a list of the stimulus words and 
asked to indicate which words had been 
followed by shock and what response 
word they had given when the shocks oc- 
curred. 


SuByEcts 


Thirty-one male undergraduate stu- 
dents served as Ss in the experiment. All 
were obtained from the elementary psy- 
chology course at The Johns Hopkins 
University. As part of the course require- 
ments, they were required to serve as Ss 
in psychological experiments. 


Results 
AWARENESS 


On the basis of the interview data it 
was possible to divide the Ss clearly into 
high- and low-level-of-awareness groups. 
The high awareness Ss were able to state 
the real basis for shocks and to describe 
what they had done to avoid them. They 
were also able to identify correctly three 
or more of the critical stimulus words as 
well as the response they had given that 
led to punishment. All reported deliber- 
ately withholding punished responses 
while trying to think of another response 
to substitute for it. However, they all 
reported that after a few trials it was no 
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longer necessary to withhold the punished 
responses deliberately since the new, or 
safe, response began to occur “automati- 
cally.” 

The low awareness Ss, on the other 
hand, were unable to state any reasons 
for the shock other than the misinforma- 
tion the E had given them prior to the 
experiment. Occasionally they expressed 
hypotheses that were quite unrelated to 
the real basis for shock and which were 
quite at variance with their actual be- 
havior. They were unable to provide an 
accurate description of changes in their 
behavior and all stated that they had not 
learned how to avoid getting shocks. 
When asked to indicate which of the 
stimulus words had been followed by 
shock, their selection was random. In no 
case were their selections more than 20 
per cent correct. 

It was possible to classify eleven of the 
Ss as having a high level of awareness or 
insight and another eleven Ss as having a 
low level of insight. There were another 
five Ss who could not be clearly placed in 
either the insight or the noninsight group. 
These Ss seemed to have a vague idea as 
to the reasons for shock and what they 
needed to do to avoid them, but their 
verbalizations were not definite enough to 
permit clear-cut decisions. We have la- 
beled these Ss as the partial insight group. 
The remaining four Ss resisted classifica- 
tion on our insight criteria. Three of these 
Ss had adopted an incorrect hypothesis 
concerning the shocks. While their hy- 
potheses were incorrect, they were none- 
theless effective in avoiding shocks. For 
example, two of these Ss had the hypothe- 
sis that shocks occurred when they gave 
synonyms and they had changed all of 
their responses to avoid synonyms. The 
other two Ss had resorted to using only 
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two response words, such as, “good” and 
“bad” for all stimulus words. ‘The data 
from these four Ss were excluded from 
further analysis. 

Since we were successful in obtaining 
two levels of awareness or insight in our 
Ss, we have treated insight as an inde- 
pendent variable in the remainder of the 
data analyses. We have not presented the 
data for the partial insight group, how- 
ever, due to the small number of Ss that 
fell into this group. 


AVOIDANCE LEARNING 


Both the insight and noninsight groups 
were quite successful in learning to avoid 
the punished associations. As Fig. 1 
shows, the number of repetitions of pun- 
ished responses decreases rapidly for both 
groups while the number of nonpunished 
responses that were repeated from trial to 
trial tends to remain constant. For the 
insight group, a mean of 68.2 per cent of 
the first-trial, nonpunished response words 
were repeated on Trial 7 while only 3.6 
per cent of the punished responses were 
repeated on this trial. A t test of the 
difference between these two means re- 
sulted in a t value of 12.2 which with ten 
degrees of freedom was significant beyond 
the .001 level. The same comparison for 
the noninsight group shows the mean 
percentage of repetition of the first-trial, 
nonpunished responses on Trial 7 to be 
60.0 per cent as compared with a mean 
percentage of 10.9 for the punished re- 


3 In nearly all of the subsequent com- 
parisons it was found that the partial in- 
sight Ss were intermediate between the in- 
sight and the noninsight groups although 
their performance more closely resembled 
that of the insight Ss. 
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sponses. The t value of 6.21 is again quite 
significant (p < .001).* 

While both the insight and noninsight 
groups show marked and reliable evidence 
of avoidance learning in this experimental 
situation, there does not appear to be any 
reliable evidence of a difference in rate of 
learning between these two groups. From 
Fig. 1, it appears that the noninsight 
group showed a tendency for more avoid- 
ance of shocked responses on Trials 2 
through 4, but a t test based upon the 
mean percentage of shocked responses for 
each S in the two groups summed through 
these three trials does not approach statis- 
tical reliability (t = 1.42, p > .10). Also 
the same comparison between the insight 
and noninsight Ss on Trials 5 through 7 
yields a t of 1.44 which is again insignifi- 
cant (p > .10). 

From Fig. 1 it appears that the nonin- 
sight group tended to give fewer first-trial 
responses to the noncritical stimuli than 
did the insight group. To determine 
whether this difference was reliable, the 
mean percentage of first-trial responses 


4 An over-all analysis of variance of these 
data was not justified due to the marked 
heterogeneity of variance that existed from 
the early to the late trials and the skew- 
ness of the distributions on the late trials. 
The t tests that have been employed here 
either have been corrected for heterogeneity 
of variance by the method suggested by 
Cochran and Cox (1) or the comparisons 
are between data that show reasonable evi- 
dence of meeting the underlying assump- 
tions involved. 

As a further precaution all statistical 
analyses involving percentages in this study 
were repeated using an arc-sine transforma- 
tion of the percentages. In no case did the 
analyses using the transformed data result 
in significance levels appreciably different 
from those reported for the untransformed 
data. 


given by each S on Trials 2 through 7 was 
computed. The means of these mean per- 
centages were 68.8 for the insight group 
and 58.8 for the noninsight group. The 
resulting t of 1.22 with 20 df does not 
approach accepted levels of statistical re- 
liability and we cannot conclude that the 
two groups differ on the repetition of first- 
trial associations on subsequent trials. 

A further confirmation of the lack of 
effect of insight upon the rate of avoid- 
ance learning is found when we compare 
the number of trials required by the in- 
sight and the noninsight groups to reach 
the criterion of two successive trials with- 
out a repetition of a punished response. 
The results of this analysis are seen in 
Table 2. As this table shows, the mean 
number of trials required for both groups 
is nearly identical and the t test falls far 
short of acceptable levels of significance. 


Reaction TIMES 


While there is no evidence of differ- 
ences in rate of avoidance learning be- 
tween the insight and the noninsight 
Ss, there are some marked differences be- 
tween these two groups in reaction times 
to stimulus words that have had punished 
responses (critical stimuli). On each trial 
the median reaction time to critical and 
noncritical stimuli was computed for each 
S. In Fig. 2 the mean of these median 
reaction times as a function of number 
of trials is shown for the insight and the 
noninsight groups. For the noninsight 
group the mean reaction times for both 
the five critical and the ten noncritical 
stimuli decreases as a function of trials. By 
the last trial the reaction times are vir- 
tually the same for both critical and non- 
critical words. 

For the insight group, however, the rela- 
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trials, and critical words that appears in 
Fig. 2, a modified four-way analysis of 


noncritical stimuli as a function of trials. 
From Eriksen and Kuethe: Avoidance 
conditioning of verbal behavior without 


variance (insight, critical stimuli, trials, awareness: A paradigm of repression. 
and Ss) was performed. The analysis used 
was identical to that described by Lind- 


quist as Plan VI (5). The data for this 
analysis were the median reaction times 


5 Only the first four trials were used in 
this analysis since a number of the Ss in 


for critical and noncritical stimuli for each both groups had reached the avoidance 
S on each of the first four trials The criterion by the end of the fourth trial. 
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TABLE 2* 
Number of Trials to Reach the Criterion 


VARIANCE 
GROUPS MEAN ESTIMATE t 
Insight 4.18 2.8 09 
Noninsight 4.27 6.8 R 


* Note: The criterion trials have been omitted from the 


computations. 


From Eriksen and Kuethe: Avoidance conditioning of verbal 
behavior without awareness: A paradigm of repression. 


summary of this analysis is given in 
Table 3.8 

Our main concern in this analysis was 
whether the trend of reaction times to the 
critical stimuli as a function of trials in 
the insight group was reliably different 
from the trend for the noncritical words 
and for both critical and noncritical words 
in the noninsight group. This question 
can be answered by the triple interaction 
between groups, critical stimuli, and trials. 
As is seen in Table 3, this interaction is 
highly significant (p < .001). 

This difference in reaction time to 
critical and noncritical words between the 
insight and the noninsight groups pro- 
vides us with an independent check upon 
the validity of classifying these Ss as in- 
sightful or insightless on the basis of their 
verbal statements. The increase in re- 
action time to critical stimuli in the in- 
sight group is what might be expected in 
view of their statements that they deliber- 
ately withheld responses that had been 
punished while they attempted to think 


6 Bartlett's test for heterogeneity of vari- 
ance did not reach significance at the .05 
level. 


of new responses. It should also be noted 
that the reaction-time data bear out their 
statements that they soon learned to think 
of nonpunished responses “automatically” 
since the reaction times for the last trials 
closely approach those for the noncritical 
stimuli. 

The analysis in Table 3 also confirms 
several other effects that are indicated in 
Fig. 2. Trials are, of course, a significant 
source of variation, but there is no over-all 
difference between the insight and the 
noninsight groups other than the inter- 
actions with other variables. The main 
effect attributed to critical and noncritical 
words is significant at the .05 level, sug- 
gesting that the reaction times to the 
critical words tended to be somewhat 
longer during the first four trials. The only 
other significant effect is the interaction 
between trials and the insight and non- 
insight groups. Inspection of Fig. 2 shows 
that for the insight group, reaction times 
decreased at a slower rate for the first 
three trials than did the reaction times for 
the noninsight group. 


CHAINED ASSOCIATIONS 


Following the avoidance conditioning 
on the word-association test, the Ss were 
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TABLE 3 


Summary of the Analysis of Variance of the 
Reaction-Time Data for Trials 14 


eee 


SUM OF 
SOURCE SQUARES df F ratio P 
Total 47.32 175 
Trials 1.46 3 49/.07 = 7.00 <.001 
Critical stimuli 1.49 1 1.49/21 = 7.09 <.05 
Insight 1.03 1 1.03/1.36= .76 >.10 
Subjects 27.13 20 1.36/07 = 19.42 <.001 
Trials X critical stimuli 29 3 10/07 = 1.43 >.10 
Trials X insight 95 3 .32/.07 = 4.57 <.01 
Critical stimuli X insight 07 1 07/21 = 33 >.10 
Trials X critical stimuli X insight 2.06 3 69/.07 = 9.86 <.001 
Within-subject error terms: 
pooled subjects by trials 4.25 60 07/ 
pooled subjects by critical 4.15 20 21/ 
stimuli 
pooled subjects by trials by 4.44 60 .07/ 


critical stimuli 


From Eriksen and Kuethe: Avoidance conditioning of verbal behavior without aware 
ness: A paradigm of repression. 


informed that there would be no more 
shocks in the experiment. They were then 
asked to chain-associate for 15 seconds to 
each of the stimulus words. In Table 4 
we have presented a breakdown of the 


chained association data for the insight 
and noninsight Ss in terms of mean num- 
ber of associations and mean number of 
first-trial response words repeated as a 
function of critical and noncritical stimuli. 


TABLE 4 


Comparison of Groups on the Average Number of Chained Associations 
per Stimulus and the Average Percentage of First-Trial Responses 


——— ES or 


MEAN PERCENTAGE 


MEAN NUMBER OF FIRST-TRIAL 
OF ASSOCIATIONS RESPONSES REPEATED 
Stimuli Stimuli 
Groups 
Critical Noncritical Critical Noncritical 
Insight 45 44 49 74 
Noninsight 44 4.5 50 66 


From Eriksen and Kuethe: Avoidance conditioning of verbal behavior without aware- 


ness: A paradigm of repression. 
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The data on total associations and on 
percentage of repetitions of the first-trial 
words were separately analyzed by a modi- 
fied three-way classification analysis of 
variance (insight, critical words, and Ss). 
The analysis for total associations revealed 
no significant effects. This is apparent 
from Table 4. However, the analysis of 
percentage of repetitions of first-trial re- 
sponses resulted in one significant effect 
(p < .01). More first-trial responses to 
noncritical stimuli than to critical stimuli 
were elicited during chained associations. 
This finding indicates that the effects of 
shocks upon the Ss’ associations have per- 
sisted despite a somewhat different task 
and the conscious knowledge that electric 
shocks will no longer occur. 


DISCUSSION 


In order to explain the phenomena of 
repression in terms of the principles used 
in describing avoidance conditioning and 
the effects of punishment as Dollard and 
Miller (3) have done, it is necessary to 
show that implicit verbal behavior or 
thoughts are analyzable into stimulus- 
response sequences. It is also necessary to 
show that these stimulus-response se- 
quences are learned and modified by the 
same principles of reinforcement that 
govern other behavior. In their book, 
Dollard and Miller have given a plausible 
treatment of these points. 

The results of the present experiment 
have contributed another step toward an 
analysis of repression in terms of avoid- 
ance conditioning. There are two charac- 
teristics of repression that must be dem- 
onstrated by any experimental analogue of 
the repression process. In order for re- 
pression to be effective, the anxiety-pro- 
voking thought must be prevented from 
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occurring. Thus, the experimental ana- 
logue must provide reasonable evidence 
that the changes in behavior have occurred 
not only at the overt level but at the 
covert level as well. Also, since a promi- 
nent feature of repression, as clinically 
observed, is the S’s lack of awareness of 
the repression process, the experimental 
analogue must demonstrate that the 
anxiety-provoking thought is eliminated 
“automatically.” That is, the S should not 
have an awareness of having deliberately 
and intentionally changed his thoughts. 

The results of the present experiment 
seem to meet these two requirements 
quite well, especially in the case of Ss in 
the noninsight group. Not only did these 
Ss show a marked and rapid decrease in 
punished associations, but this dramatic 
change in their associations occurred with- 
out verbal awareness on their part. These 
Ss were unable under intensive question- 
ing to describe what they had done to 
avoid shocks, and they reported no aware- 
ness of having deliberately withheld asso- 
ciations in an attempt to think of a new 
association. 

Fortunately we do not have to rely 
upon the verbal reports of these Ss alone 
to support our belief that this avoidance 
learning occurred without awareness. A 
comparison of the reaction times for the 
insight and the noninsight groups lends 
confirmation to the Ss’ verbal reports. 
The insight Ss who had clear verbal 
awareness of how to avoid shocks and 
who reported having tried deliberately to 
withhold punished associations and think 
up new ones, were found to show an 
initial increase in reaction times to the 
critical stimuli for the first three trials. 
This increase in reaction time is what 
would be expected to accompany the im- 
plicit behavior that these Ss describe hav- 
ing experienced. For the noninsight 
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group, on the other hand, reaction times 
to the critical stimuli show a monotonic 
decrease from the first trial to the last. 
The reaction times to the critical stimuli 
in this group are closely comparable to 
the reaction times to the noncritical 
stimuli throughout the experiment. The 
reaction-time data for the critical words 
in the noninsight group correspond quite 
well with what would be expected of an 
“automatic” repression process.” 

While the verbalizations and the re- 
action-time data for the noninsight group 
strongly indicate that avoidance learning 
had occurred without awareness, these 
same data also suggest that the behavior 
changes occurred at the covert as well as 
at the overt level. Not only do the Ss 
from the noninsight group report a lack 
of withholding of associations, but their 
reaction-time data also indicate that their 
overt and covert responses were identical. 
Had these Ss implicitly responded with 
punished associations, it seems likely that 
their association times would have been 


7 It is interesting to equate the perform- 
ance of the insight group with the process 
of conscious suppression and the perform- 
ance of the noninsight group with the 
process of repression as these processes are 
described by Dollard and Miller (3). In 
both groups the punished responses were 
successfully avoided, but in the noninsight 
group the avoidance occurred “automati- 
cally” without awareness and without an 
increase in reaction times. In the insight 
group, on the other hand, the avoidance 
was a deliberate conscious act and was ac- 
companied by increased reaction times 
while these Ss searched for substitute re- 
sponses. In the noninsight group the data 
indicate that the thought itself or the im- 
plicit verbal response was initially condi- 
tioned while in the insight Ss the overt 
verbalization was first conditioned and then 
the thought or implicit response. 


appreciably longer to the critical stimuli 
than to the noncritical stimuli. Actually, 
however, there was little or no difference 
in the association times to the two classes 
of stimuli. Even among the Ss in the in- 
sight group, the reaction times to critical 
stimuli had become comparable to the 
reaction times for noncritical stimuli by 
the last trial. This finding again corre- 
sponds with their verbal report that after 
a few trials the new associations “came to 
mind automatically” and they no longer 
thought of the punished responses. 

One further piece of evidence that the 
shocks had effected associations on the 
implicit level is to be found in the data 
on the chained associations. Had these 
punished associations been present in 
implicit behavior, we would have ex- 
pected more of them to have attained 
overt expression when the threat of pun- 
ishment was removed. Both groups, how- 
ever, gave fewer of the punished re- 
sponses during chained association than 
would be expected on the basis of the 
number of first trial responses obtained 
to the noncritical stimuli. 

While it was not the purpose of the 
present experiment to contribute to the 
theoretical controversy concerning the 
manner in which punishment eliminates 
responses, our data seem to favor an in- 
terpretation along the lines of an in- 
hibitory process or decrement in the 
absolute response strength of the pun- 
ished responses. An increase in response 
strength of alternative responses alone 
does not seem adequate to account for 
the data obtained from chained associa- 
tions. Here the Ss had an opportunity to 
give a relatively large number of responses 
to each stimulus. Thus, it could be ex- 
pected that not only would the stronger 
responses tend to occur, but there was the 
opportunity for responses lower in the 
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response hierarchy to occur also. Yet only 
a few punished responses occurred, a re- 
sult which is all the more surprising since 
these punished responses were for the 
most part initially the dominant response 
in the hierarchy. 


SUMMARY 


The Ss were presented with a 15-item 
word-association list under the guise that 
they were taking part in an experiment to 
determine the limit of speed of associa- 
tions. They were instructed to respond 
with the first word that came to mind as 
quickly as possible after the stimulus word 
was presented. During the first trial on 
the list, the E administered a strong elec- 
tric shock immediately after five arbitrarily 
selected response words, The Ss were then 
given a number of further trials on the 
same 15 stimulus words. Every time an S 
responded with one of the five first-trial 
punished responses, he received another 
electric shock. At the conclusion of this 
phase of the experiment, Ss were informed 
that there would be no further shocks. 
They were then asked to chain-associate 
to each of the stimulus words. 

On the basis of intensive questioning 
at the conclusion of the experiment, it 
was possible to classify the Ss into insight 
and noninsight groups. The insight Ss 
were characterized by having a high de- 
gree of verbal awareness as to the basis 
for the electric shocks and what they had 
to do to avoid receiving them. The non- 
insight Ss had a low level of verbal aware- 
ness as to the reasons for the shocks and 
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what they had done to avoid them. Both 
insight and noninsight groups showed a 
rapid and marked learning of avoidance 
behavior. No reliable differences were 
found between the two groups in terms 
of rate of learning or on the number of 
trials to achieve the criterion of two suc- 
cessive trials without the occurrence of a 
punished response. However, there were 
clear differences between the two groups in 
reaction times to stimulus words that had 
elicited shocked responses. The nature of 
these differences corresponded with what 
would be expected from the Ss’ verbaliza- 
tion. Both groups showed a significant 
decrement in the number of punished 
responses that occurred during chained 
associations. The relation of these data to 
a theory of repression was discussed. 
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42. 
Operant Conditioning of 
Factor Analytic Personality Traits*’ 


Arthur W. Staats, Carolyn K. Staats, 
William G. Heard, and 
Judson R. Finley 


A. Operant Conditioning 


In recent times a number of studies 
have shown that reinforcement operates 
according to the principles of operant con- 
ditioning to strengthen complex human 
behavior. Many different types of verbal 
behavior have been operantly conditioned 
(Krasner, 1958; Salzinger, 1959). Cohen, 
et al. (1954), among others have shown 
that social reinforcers may strengthen a 
class of verbal responses. In another study 
(Staats, 1957), a class of verbal responses 
to a problem solving object was strength- 
ened through a reinforced use of the ob- 
ject in the problem. Scott (1957) has 


* From A. W. Staats, C. K. Staats, W. G. 
Heard, and J. R. Finley, Operant condi- 
tioning of factor analytic personality traits, 
J. gen. Psychol., 66, 101-114 (1962). Re- 
printed by permission of the authors and 
The Journal Press. 
1This study, part of a research project 
formulated by the first author, was spon- 
sored by the National Institute of Mental 
Health under Contract M-2381. 


conditioned attitudes through the social 
reinforcement of winning a debate. Salz- 
inger and Pisoni (1958) have operantly 
conditioned “affect” statements. Azrin 
and Lindsley (1956) have operantly con- 
ditioned cooperative behavior in children, 
while Rheingold, Gewirtz, and Ross 
(1959) have operantly conditioned a com- 
ponent of social responsiveness in infants. 
Verplanck (1955) has shown that the 
behavior of stating opinions can be 
strengthened using verbal stimuli as rein- 
forcers. Cooperative behavior, attitudes, 
social responsivity and the degree to which 
an individual is opinionated can be con- 
sidered to be aspects of personality. An- 
other study (Nuthmann, 1957) has gone 
a step further toward understanding per- 
sonality from this approach by showing 
that responses to a class of statements 
chosen to indicate acceptance or rejection 
of self could also be conditioned. Since 
each statement was presented only once, 
the success in conditioning indicated the 
functional unity of this class of responses. 

The foregoing results suggest that com- 
plex human behaviors, which we term 
personality, may develop according to the 
principles of operant conditioning. If the 
ease with which one vouchsafes opinions 
can be altered in Verplanck’s short ex- 
perimental procedure, it seems reasonable 
that a life history of reinforcement of 
opinions would produce an opinionated 
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“personality.” In the same way it is rea- 
sonable that a life history of reinforce- 
ment for social responsiveness would cul- 
minate in a socially responsive person. In 
addition, the history of reinforcement for 
statements concerning oneself should also 
affect the behavior of an individual which 
we accept as indexing his “self-concept.” 
Keller and Schoenfeld summarize such a 
general approach with the statement, 
“There is little reason to resist the conclu- 
sion that the personality development of 
the individual is a function of his own 
conditioning history” (p. 367). Skinner 
(1953) has also in a general way discussed 
the “self” or personality in terms of the 
principles of operant conditioning. 

Further studies are needed to determine 
whether facets of personality behavior 
actually are acquired through operant con- 
ditioning. Individuals behave in charac- 
teristic ways in many different situations. 
These characteristic ways of behaving are 
commonly spoken of as reflecting under- 
lying personality traits. Tests have been 
constructed to measure these traits (or, 
rather, the covariance of specific behav- 
iors). It is suggested that such measured 
personality traits have psychological status 
in that they are functionally unified 
classes of responses which have been 
operantly conditioned in the life history 
of the individual. Following from this, it 
is suggested that responses to trait items 
found through factor analysis are such 
classes of responses. Consequently, re- 
sponse induction would be expected to 
take place within such responses classes. 
Thus, strengthening the response to one 
item through reinforcement should 
strengthen this type of response to other 
items in the same trait. 

The purpose of the present study is to 
test this hypothesis. More specifically, the 
study adapts Nuthmann’s procedure to 
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test the experimental hypothesis that re- 
sponses to factor analytically derived per- 
sonality trait items (Guilford-Zimmerman 
traits) can be operantly conditioned as a 
response class. 


B. Experiment I 
1. Susyecrs 


The Ss were 102 introductory sociology 
students at Arizona State University. 


2. APPARATUS 


The experiment was conducted in a 
virtually sound-proof room. S was seated 
on one side of a table, E on the other side. 
A partition of ply-wood, painted flat black, 
was vertically mounted on the table divid- 
ing it in such a manner that the E and S 
were not visible to each other. The parti- 
tion had sides which extended back to- 
ward the S so that his side vision was also 
restricted. In the center of the partition 
there was a 214 x 4% inch opening for 
the presentation of 5 x 8 cards on which 
the trait items were printed. At each end 
of the S’s side of the partition there was a 
button, one labeled True and one labeled 
False. These were used by the S to signal 
his answers to the E. Each button acti- 
vated a light on the E’s side of the parti- 
tion. 


3. MATERIALS 


The trait of Sociability on the Guilford- 
Zimmerman was used in this experiment. 
Since the G-Z trait contains only 30 items 
and 100 were needed for the procedure, 
several items were written to be compara- 
ble to each G-Z item. Each item was 
written to capture the same or opposite 
meaning of the original item, but different 
words were used. That is, the additional 
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items were written both to mirror the 
original item and to be the converse. For 
example, “You find it easy to start con- 
versation with a stranger,” is an original 
GZ item. Matching items used were, “It 
is difficult for you to begin talking to a 
stranger,” and “You enjoy making friends 
with strangers.” Seventy of these items 
were selected to add to the 30 original 
items. 

The 100 items, plus the 40 filler items 
used by Nuthmann (1957), were then 
given to a group of 102 Ss. The total 
scores made on the 30 original items were 
then correlated with the total scores made 
on the 70 additional items. The correla- 
tion was .89, On the basis of these results, 
the items were considered to be equiva- 
lent for their use in the experiment 
proper. 

The trait items were then randomly 
assigned to one of five blocks of 20 items 
with the stipulation that there be 10 true 
and 10 false keyed responses in each 
block. The filler items were also randomly 
assigned to blocks, eight in each block. 


4. Drsicn 


The 30 Ss scoring lowest on the 100 
Sociability trait items were selected for the 
experiment proper. These Ss were assigned 
to an Experimental Group and a Control 
Group in matched pairs, on the basis of 
their Sociability scores. As a result of the 
assignment of the matched pairs, the Ex- 
perimental Group mean was 47.33 and 
the Control mean was 47.33. 

To control the order effect of the pres- 
entation of blocks, presentation of item 
blocks was arranged through use of a 
systematic 5 x 5 latin square. Five orders 
of presentations of item blocks were used, 
each block being presented once at each 
position in the order. Since there were 


15 Ss in each group, three Ss received each 
order of presentation of blocks, in a repli- 
cated latin square design. 


5. PROCEDURE 


In the procedure each of the 100 items 
was presented to the S in the window of 
the apparatus. The S pressed a button to 
indicate his True or False answer. The 
following instructions were read to the S: 


Some time ago in one of your classes you 
were given a personality test. I am interested 
in finding out how the different ways of pre- 
senting a personality test may cause different 
answers to be given to it. 

Now, you are going to be given the test 
in a different manner. The statements which 
you are to answer will be shown on cards in 
this opening. Read the card and then press 
the button which indicates your answer to 
the statement. If your answer is True, then 
press the button marked True. If your an- 
swer is False, then press the button marked 
False. However, be sure to read each state- 
ment carefully before you answer. Decide 
whether the statement is mostly true or 
mostly false as it concerns you. Then press 
the appropriate button for a second or so. 
Do not take too long to decide your answer 
once you have carefully read the statement. 
Although many items may seem to be iden- 
tical, they are not; each item is different. It 
is not unusual for people to change their 
answers on personality tests when taking 
them a second time, so do not worry about 
being consistent. We are interested in your 
first impression right now, as you read the 
card. 

Please do not speak out or ask questions 
until I have indicated the experiment is 
finished. 

We are not interested in individuals as 
such, but only in the group as a whole. You 
will be assigned a number and your name 
discarded, so try to be as honest as you can 
in giving your answers. 


For Experimental Group Ss, each time 
a response was given which indicated so- 
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ciability the E administered reinforcement 
by saying good, very good, that’s fine, etc. 
Nothing was said to the control S. 


6. RESULTS 


At each block the “sociable” responses 
to the items were tabulated to determine 
S’s score for the block. In order to control 
for starting level, the score for the Control 
S was subtracted from the score of the 
matched Experimental S, yielding a “dif- 
ference” score for each matched pair. The 
curve of the mean difference scores is 
shown in Figure 1. 

Table 1 presents a summary of an Alex- 
ander trend analysis (1946) for the differ- 
ence scores. The basic error term in the 
analysis was Individual Deviations from 


Mean difference 


4 2 3 4 5 
Blocks 


FIG. 1. The conditioning of the trait of 
sociability. The abscissa represents the 
order of the blocks of items presented to 
the subjects. The ordinate represents the 
difference between the means of the Ex- 
perimental and Control groups. The in- 
crease in the difference scores indicates 
that Experimental subjects are responding 
to a greater extent than the Control sub- 
jects in the direction of Sociability. The 
means for the blocks in order were: —.73, 
1.00, .47, 1.87, 1.47. From Staats, Staats, 
Heard, and Finley: Operant conditioning 
of factor analytic personality traits. 
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Estimation. Line E shows that there were 
wide differences between Individual 
Means (F = 16.49, p < .01) on the trait 
of sociability. The ratio of variance due to 
Group Deviations from Linearity to the 
error term variance results in an F less 
than 1, allowing the conclusion that there 
is no systematic fluctuation apart from 
linear trend. Between Individual Slopes is 
also of the same magnitude as error, indi- 
cating that the slopes of the individual 
least square straight lines are not signifi- 
cantly different. The critical term in the 
analysis is Group Slope. The F of 5.05 
(p < .05) indicates that there is a signifi- 
cant linear trend for the whole group, i.e., 
there is a significant increase in number of 
sociable responses for the Experimental 
Group relative to the Control Group. 


C. Experiment II 
1. SUBJECTS 


Fifty Ss in an introductory sociology 
class at Arizona State University were em- 
ployed in selecting items for use in this 
experiment. Sixty-two additional introduc- 
tory sociology students took the complete 
Guilford-Zimmerman Test. From these 
test results, the 24 Ss with the lowest 
scores on the General Activity trait were 
selected for the experiment proper. 


2. APPARATUS 


The apparatus was the same as was used 
in Experiment I. 


3. MATERIALS 


In this experiment the trait of General 
Activity was used in the place of Socia- 
bility. Thirty-four supplementary items 
were composed to add to the original 30 
items. Twenty-eight from the Guilford- 
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TABLE 1 
Summary of Alexander Trend Analysis of the Difference Scores 
between Experimental and Control Subjects on Sociability Items 
ERROR MEAN 
SOURCE OF VARIATION TERM df SQUARE F 

A. Individual deviations from estimation 42 8.24 
B. Group deviation from linearity A 3 6.55 79 
C. Between individual slopes A 14 11.95 1.45 
D. Group slope A 1 41.61 5.05* 
E. Between individual means A 14 135.90 16.49** 


*p<.05. 
Sp <0k. 


From Staats, Staats, Heard, and Finley: Operant conditioning of factor analytic person 


ality traits. 


Zimmerman which did not involve the 
General Activity factor were selected for 
filler items. ‘These items were randomly 
assigned in constructing a test booklet 
which was given to the 50 Ss. The correla- 
tion between the original and supple- 
mentary items was only .69. Because of 
the low correlation, a Fan item analysis 
(1952) was used to eliminate the eight 
poorest supplementary items. A new cor- 
relation coefficient of .81 was obtained. 

Thus, the items which were finally se- 
lected for the experiment consisted of the 
original 30 G-Z General Activity items, 
plus 26 supplementary items, plus 28 
filler items, The 56 General Activity items 
were randomly assigned to four blocks of 
14 items each, with the additional stipula- 
tion that there be half True keyed items 
and half False keyed items in each block. 
The 28 filler items were also randomly 
assigned to the blocks with seven items in 
each block. These four blocks were then 
systematically randomized in a 4 x 4 latin 
square for the order of presentation to the 
Ss. 


4. Desicn 


The items selected in the above pro- 
cedure were put into a booklet and the 
inventory was given to 62 new Ss. The 
24 Ss scoring lowest on this test were 
selected for the experiment proper. These 
Ss were divided into 12 matched pairs on 
the basis of the rank order of their Gen- 
eral Activity scores on the G-Z scale. The 
mean score of the 12 Ss who became the 
Experimental Group was 12.42. The mean 
score of the Ss who became the Control 
Group was 12.58. Since there were four 
orders of presentation of the blocks and 
12 pairs of Ss, three pairs of Ss were run 
under each order of presentation in the 
replicated latin square design. 


5. PROCEDURE 


The procedure was the same as that 
used in Experiment I with the exception 
that only the word Good was used as a 
reinforcing stimulus by the E, and this 
was delivered in a neutral manner. Noth- 
ing was said to the Control Ss. 
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6. RESULTS 


The analysis of these results was con- 
ducted in essentially the same fashion as 
in Experiment I. The curve of the differ- 
ence scores for the operant conditioning 
of the General Activity trait is shown in 
Figure 2. 


Mean difference 


"| 2 3 4 
Blocks 


FIG. 2. The conditioning of the trait of 
general activity. The abscissa represents 
the order of the blocks of items presented 
to the subjects, The ordinate represents 
the difference between the means of the 
Experimental and Control groups. The 
increase in the difference scores indicates 
that Experimental subjects are responding 
to a greater extent than the Control sub- 
jects in the direction of General Activity. 
The means for the blocks in order were: 
1.00, 1.00, 2.00, 2.17. From Staats, Staats, 
Heard, and Finley: Operant conditioning 
of factor analytic personality traits. 


Table 2 shows the summary of the 
Alexander trend analysis for the difference 
scores on the General Activity trait. Using 
Individual Deviations from Estimation as 
the error term, Between Individual Means 
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was highly significant (F = 27.09, p< 
.01). That there was no systematic fluctua- 
tion apart from a linear trend is shown 
by the non-significant Group Deviations 
from Linearity term. Since the Between 
Individual Slopes term was significant at 
the .05 level (F = 2.66), we may conclude 
that the slopes of the individual least 
square straight lines were different within 
the group. For this reason, Between In- 
dividual Slopes was used as the error term 
for testing the significance of Group 
Slopes variance. The F of 2.26 (p < .05) 
indicates that there was a significant linear 
trend for the whole group which could 
not be accounted for by the difference 
between individuals, The conclusion was, 
therefore, that a significant increase in the 
extent of difference between experimental 
and control Ss resulted from the condi- 
tions of reinforcement for the Experimen- 
tal Group. 


DISCUSSION 


The results of the present study are in 
agreement with other studies which have 
indicated that classes of verbal responses 
may be strengthened through the rein- 
forcement of individual members of the 
response class. In particular, the present 
experimental results support the conten- 
tion that responses to classes of personality 
test items may be operantly conditioned. 
In the present study, trait items estab- 
lished on the basis of factor analysis were 
used. It was found that reinforcing one 
“sociable” response, for example, tended 
to strengthen other social responses in the 
Sociability trait. The significant strength- 
ening of sociable responses occurred in the 
short experimental procedure. It would 
seem likely that a life history of reinforce- 
ment for verbal and motor sociable re- 
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TABLE 2 
Summary of Alexander Trend Analysis of the Difference Scores 
between Experimental and Control Subjects on General Activity Items 
EE A a 


ERROR MEAN 
SOURCE OF VARIATION TERM df SQUARE F 
A. Individual deviations from estimation 22 2.03 
B. Group deviation from linearity A 2 1.00 49 
C. Between individual slopes A 11 5.4 2.66* 
D. Group slope c 1 12.2 2.26* 
E. Between individual means A 11 55.0 27.09** 


"p0 
A A 


From Staats, Staats, Heard, and Finley: Operant conditioning of factor analytic per- 


sonality traits. 


sponses would lead to a strong trait of 
sociability. 

Thus, the results indicated that the 
Guilford-Zimmerman trait of Sociability, 
found through factor analysis, is com- 
posed of items which form a unified class 
of responses, i.e, one within which re- 
sponse induction occurs. This suggests 
that personality traits are classes of re- 
sponses which develop according to the 
principles of operant conditioning. In ad- 
dition, the results also suggest that the 
psychological processes underlying factors 
consist of such unified classes of responses. 

This latter conclusion has relevance for 
the various psychological conceptions of 
factor traits. As has been indicated by 
Cattell (1946) and Thurstone (1947) 
there are several ways to consider traits. 
Thurstone considers interpretations of 
factors to be assumptions which depend 
“on one’s philosophical preferences and 
manner of speech, and on how much one 
already knows about the domain to be 
investigated . . .” (p. 56). He prefers the 
approach where, “No assumption is made 
about the nature of these functions, 


whether they are native or acquired or 
whether they have a cortical locus” (p. 
57). Cattell discusses the various interpre- 
tations of traits at some length and de- 
scribes six types of interpretations. (a) 
One conception of traits is dynamic and 
teleological and considers traits to be “col- 
lections of behavior manifestations in 
which all are directed to the same ulti- 
mate biological goal . or to some 
intermediate goal . . .” (p. 63). (b) An- 
other interpretation is that the environ- 
ment molds a cluster of behaviors. “[T]he 
elements of a social mold trait will covary 
. . . because a single external influence— 
e.g, family, school, national culture pat- 
tern—has impressed all of them, as from 
a single focus” (p. 66). Cattell also sug- 
gests, “Or, in the terms of one psycho- 
logical school, the habits have been ‘re- 
warded or punished’ in common” (p. 64). 
(c) [I]n many cases the term is used to 
refer to a purely logical division of be- 
havior, having no relation whatsoever to 
any real structures in the typical organism 
...” (p. 66). (d) Traits are also con- 
sidered to be constitutional unities of 
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behavior, and (e) Reactions which all 
emerge together in some developmental 
process. (f) In addition, there are traits 
for which there is no explanation of the 
unity of the parts. 

It would seem that the different con- 
ceptions of traits summarized by Cattell 
are assumptions, or, perhaps, in Thur- 
stone’s terms “philosophical preferences.” 
However, interpretation (b), especially, is 
an hypothesis which, although in its full 
description is not couched in clear be- 
havioristic terminology, is nevertheless 
congruent with an S-R orientation. That 
is, in S-R terms, behaviors are a func- 
tional class because they have been sub- 
jected to the same conditions of reinforce- 
ment. 

Cattell continues to say that psycholo- 
gists have greater difficulty in accepting 
the interpretation of factors as functional 
unities arising under environmental in- 
fluence, (b), than because of constitu- 
tional traits. He feels the most disturbing 
limitation comes from the consideration 
of environmental mold traits as historical 
unities only, suggesting an absence of pre- 
diction to the psychometrist. He attempts 
to correct this view by saying: 


[T]rait elements formed under one en- 
vironmental influence are likely to have in 
common other things than the common 
variance impressed at the time. Habits 
formed at the same place and the same age 
are likely to share reactivity to the same 
stimuli, to show the same amount of func- 
tional autonomy after a certain lapse of time, 
to follow the same curves of extinction, etc. 
There are probably as yet unknown similari- 
ties through coincidence of place and age in 
habit formation. . . . 

Consequently the environmental mold 
trait has more than a historical unity—i.e., a 
unity existing at some time in the past. It 
will tend to persist and function as a unity. 
. . . However, these circumstances argue 
that the environmental mold trait will more 


frequently than the constitutional trait, ap- 
pear as a less well-defined or more frag- 
mentary factor (pp. 90-91). 


In this discussion, Cattell thus adds 
further details which agree with an S-R 
concept of personality traits, for example, 
his reference to habits “formed at the 
same place and age are likely to share 
reactivity to the same stimuli...” In 
S-R terms, it would be said that a class of 
responses which has been reinforced in 
the presence of certain stimuli will come 
under the control of those stimuli. 

In summary, several points may be evi- 
dent from the above: (a) psychometrics 
is interested not only in description for 
the purpose of predicting later behavior 
from present behavior, but it is also inter- 
ested in accounting for the behavior de- 
scribed; (b) some of the conjectures made 
concerning factors are in agreement with 
an S-R approach; and (c) experimental 
evidence is necessary to support the con- 
jectures made concerning the principles 
involved in the development of traits. 

In this respect, the present experiment 
produced evidence that certain func- 
tional unities as described by mathemati- 
cal unities of covariation, may be consid- 
ered to be classes of responses developed 
according to the principles of operant con- 
ditioning. Thus, it is found that the psy- 
chometric approach and the experimental 
S-R approach can be considered to have a 
complementary relationship at this point. 
These conclusions suggest, further, that 
S-R principles and methods can be ex- 
tended to the psychometric study of fac- 
tors in a way which may put psychological 
meat on psychometric’s descriptive bones, 
i.e., discover the principles relating certain 
determinants to the development, con- 
sistency, and change of “traits” of behav- 
ior. It is suggested that such an extension 
of S-R principles will provide some of the 
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theories of factors with the support of 
experimental evidence. In addition, the 
principles of trait development, once 
found, should introduce an element of 
control into the developmental situation 
not obtained from the study of S-R laws. 

The qualification will no doubt arise 
that this study has increased the strength 
of verbal responses through the systematic 
application of reinforcement, but that this 
may not pertain to the actual “trait” of 
sociability. That is, the person may in 
the experimental situation make sociable 
verbal responses, but will he become more 
sociable as a result of the experimental 
treatment? The first answer to this qualifi- 
cation should be that this is an empirical 
question. Experiments should be con- 
ducted to ascertain if strengthening verbal 
responses affects other behavior of an in- 
dividual. 

There are, however, some points from 
other approaches that can be brought to 
bear on this question. First, psychotherapy 
is a procedure which is conducted pri- 
marily upon a verbal level. The client 
speaks to the therapist, the therapist ver- 
bally responds to the client, sometimes 
with responses which have reinforcing 
value. The client’s verbal behavior changes 
in this procedure and it is assumed that 
this results in appropriate changes in the 
clients extra-therapeutic behavior. It 
might also be assumed that in studies 
indicating change in verbal behavior on 
tests (e.g, Kaufman, 1950), the change 
is a resultant of the reinforcement condi- 
tions during therapy. 

In addition, experiments have been con- 
ducted which indicate the general rela- 
tionship between language responses and 
their motoric counterparts. For example, 
the availability of a verbal response has 
been shown to be predictive of the avail- 
ability of a corresponding instrumental re- 


sponse (Saugstad, 1952; Judson, Cofer, 
and Gelfand, 1956). It has also been 
shown that reinforcing an instrumental 
response results in strengthening a corre- 
sponding verbal response hierarchy 
(Staats, 1957). 

Lest this appear to oversimplify a com- 
plicated situation, it should also be 
pointed out that it has also been generally 
observed that verbal behavior and motoric 
behavior are frequently discrepant. In the 
clinical situation this is recognized in the 
statement that verbal responses in therapy 
may occur only on an intellectual level, 
and thus may not indicate real changes in 
the client. Therefore, it is said, verbal be- 
havior must indicate changes on an emo- 
tional level, if therapy is to be success- 
falai 

At this point, however, it should be ap- 
parent that this type of rationale has not 
yet been detailed satisfactorily in con- 
sidering (a) why verbal response classes 
operantly condition, i.e., why response in- 
duction occurs in diverse verbal responses; 
(b) why generalization sometimes takes 
place from verbal response to motor re- 
sponse; and (c) why the generalization 
sometimes does not take place. It is thus 
clear, in line with the previous conclusion 
that S-R principles could be applied to an 
understanding of factors, that while S-R 
theoretical conceptions of personality 
traits need to be developed in much 
greater detail, at this point they appear 
to outline a most promising approach to 
the long-standing problems involved. 
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43. 
Positive Reinforcement and Behavioral Deficits 
of Autistic Children* 


Charles B. Ferster 


* From C. B. Ferster, Positive reinforce- 
ment and behavioral deficits of autistic 
children, Child Development, 32, 437-456 
(1961). Reprinted by permission of the 


Infantile autism, first described by Kan- 
ner (6), is a very severe psychotic dis- 
turbance occurring in children as young 
as 2 years. At least outwardly, this child- 
hood schizophrenia is a model of adult 
schizophrenia. Speech and control by the 


author and the Society for Research in 
Child Development. 
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social environment are limited or absent; 
tantrums and atavistic behaviors are fre- 
quent and of high intensity; and most 
activities are of a simple sort, such as 
smearing, lying about, rubbing a surface, 
playing with a finger, and so forth. Infan- 
tile autism is a relatively rare form of 
schizophrenia and is not important from 
an epidemiological point of view. The 
analysis of the autistic child may be of 
theoretical use, however, since his psy- 
chosis may be a prototype of the adult's; 
but the causal factors could not be so 
complicated, because of the briefer en- 
vironmental history. In this paper, I 
should like to analyze how the basic vari- 
ables determining the child’s behavior 
might operate to produce the particular 
kinds of behavioral deficits seen in the 
autistic child. To analyze the autistic 
child’s behavioral deficits, I shall proceed 
from the general principles of behavior, 
derived from a variety of species, which 
describe the kinds of factors that alter the 
frequency of any arbitrary act (3, 10). 
The general principles of behavior ap- 
plied to the specific situations presumably 
present during the child’s developmental 
period will lead to hypotheses as to spe- 
cific factors in the autistic child’s home 
life which could produce the severe 
changes in frequency as well as in the 
form of his behavior. As an example, con- 
sider the effect of intermittent reinforce- 
ment, many of the properties of which 
are comparatively well known from ani- 
mal experiments. To find how intermit- 
tent reinforcement of the autistic child’s 
behavior might produce deficits, we would 
first determine, in the general case, what 
specific orders of magnitude and kinds of 
schedules produce weakened behavioral 
repertoires. The factors in the child’s 
home life could be examined to deter- 
mine estimates of what kind of circum- 


stances could conceivably cause schedules 
of reinforcement capable of the required 
attenuation of the child’s behavior. The 
analysis will emphasize the child’s per- 
formance as it is changed by, and affected 
in, social and nonsocial environment, As 
in most problems of human behavior, the 
major datum is the frequency of occur- 
rence of the child’s behavior. Although 
the account of the autistic child’s devel- 
opment and performance is not derived 
by manipulative experiments, it may still 
be useful to the extent that all of the 
terms of the analysis refer to potentially 
manipulable conditions in the child’s en- 
vironment and directly measurable as- 
pects of his performance. Such an analysis 
is even more useful if the performances 
and their effects on the environment were 
described in the same general terms used 
in systematic accounts of behavior of ex- 
perimental psychology. 

Some of our knowledge of the autistic 
child’s repertoire must necessarily come 
from anecdotal accounts of the child’s 
performance through direct observation. 
Although such data are not so useful as 
data from controlled experiments, they 
can be relatively objective if these per- 
formances are directly observable and po- 
tentially manipulable. A limited amount 
of experimental knowledge of the dy- 
namics of the autistic child’s repertoire is 
available through a program of experi- 
ments in which the autistic child has 
developed a new repertoire under the 
control of an experimental environment 
(5). These experiments help reveal the 
range and dynamics of the autistic child’s 
current and potential repertoires. In gen- 
eral, the autistic child’s behavior will be 
analyzed by the functional consequences 
of the child’s behavior rather than the 
specific form. The major attempt will be 
to determine what specific effects the 
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autistic child’s performance has on that 
environment and how the specific effects 
maintain the performance. 


Specification of the Autistic Child’s 
Performance 


We must first describe the current 
repertoire of the autistic child before we 
can describe possible environmental con- 
ditions that might produce gross behav- 
ioral deficits. A topographic description of 
the individual items of the autistic child’s 
repertoire would not, in general, distin- 
guish it from the repertoires of a large 
number of functioning and nonhospital- 
ized children, except perhaps in the degree 
of loss of verbal behavior. The autistic 
child’s behavior becomes unique only 
when the relative frequency of occurrence 
of all the performances in the child’s 
repertoire is considered. In general, the 
usual diagnostic categories do not ade- 
quately characterize the children in the 
terms of a functional analysis of behavior. 
Hospitalization of a child usually depends 
upon whether the parent can keep the 
child in the home, rather than a func- 
tional description of the role of the paren- 
tal environment in sustaining or weaken- 
ing the child’s performance. 


RANGE OF PERFORMANCES 


Although the autistic child may have a 
narrower range of performances than the 
normal child, the major difference be- 
tween them is in the relative frequencies 
of the various kinds of performances. The 
autistic child does many things of a simple 
sort—riding a bicycle, climbing, walking, 
tugging on someone’s sleeve, running, etc. 
Nevertheless, the autistic child spends 
large amounts of time sitting or standing 
quietly. Performances which have only 
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simple and slight effects on the child’s en- 
vironment occur frequently and make up 
a large percentage of the entire repertoire, 
for example, chewing on a rubber bal- 
loon, rubbing a piece of gum back and 
forth on the floor, flipping a shoelace, or 
turning the left hand with the right. Al- 
most all of the characteristic performances 
of the autistic child may be observed in 
nonhospitalized children, but the main 
difference lies in the relative importance 
of each of these performances in terms of 
the total repertoire. Conversely, isolated 
instances of quite “normal” performances 
may be seen in the autistic child. Again, 
the relative frequency of the performances 
defines the autistic child. 


SoctaL CONTROL OVER THE 
CHILD’S PERFORMANCE 


The major performance deficits of the 
autistic child are in the degree of social 
control: The kinds of performances which 
have their major effects through the medi- 
ation of other individuals. 

The main avenue of social control in a 
normal repertoire is usually through 
speech, a kind of performance that is 
unique because it produces the conse- 
quences maintaining it through the medi- 
ation of a second person (12). Autistic 
children almost always have an inade- 
quately developed speech repertoire, vary- 
ing from mutism to a repertoire of a few 
words. Even when large numbers of words 
are emitted, the speech is not normal in 
the sense that it is not maintained by its 
effect on a social environment. When 
normal speech is present, it usually is in 
the form of a mand (12). This is a simple 
verbal response which is maintained be- 
cause of its direct reinforcement, €g., 
“Candy!” “Let me out.” The main vari- 
able is usually the level of deprivation of 
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the speaker. It lacks the sensitive inter- 
change between the speaker and listener 
characteristic of much human verbal be- 
havior, as for example, the tact (see be- 
low). The reinforcement of the mand 
largely benefits only the speaker. In the 
case of the autistic child, it frequently 
affects the listener (parent), who escapes 
from the aversive stimulus by presenting 
a reinforcing stimulus relevant to the 
child’s mand. At suppertime, the child 
stands at the door screaming loudly and 
kicking the door because the ward attend- 
ants in the past have taken the child to 
supper when this situation became aver- 
sive enough. Sometimes, the form of the 
mand is nonvocal, although still verbal, as 
when the mand involves tugging at a 
sleeve, pushing, or jostling. The dynamic 
conditions which could distort the form 
of a mand into forms most aversive to a 
listener will be described below. In con- 
trast to the mand, the tact (12) is almost 
completely absent. This form of verbal 
behavior benefits the listener rather than 
the speaker and is not usually relevant to 
the current deprivations of the speaker. 
This is the form of verbal behavior by 
which the child describes his environ- 
ment, as, for example, “This is a chair”; 
“The mailman is coming.” This latter 
kind of verbal control is generally absent 
or weak, as with other kinds of verbal be- 
havior except an occasional mand. 


ATAVISMS 


Tantrums, self-destructive behavior, 
and performances generally aversive to an 
adult audience are relatively frequent in 
the autistic child’s repertoire. Most au- 
tistic mands depend on an aversive effect 
of the listener for their reinforcement. To 
the extent that social behavior is present 
at all, its major mode is through the pro- 


duction of stimuli or situations which are 
aversive enough so that the relevant 
audience will escape or avoid the aversive 
stimulus (often with a reinforcer). For 
example, on the occasion of candy in the 
immediate vicinity, the child screams, 
flails about on the floor, perhaps striking 
his head, until he is given some candy. 
There is evidence that much of the 
atavistic performance of the autistic child 
is operant, that is, controlled by its conse- 
quence in the social environment. The 
operant nature of the autistic child’s 
atavisms is borne out by experiments 
where a child was locked in an experi- 
mental space daily for over a year. There 
was no social intervention, and the experi- 
mental session was usually prolonged if a 
tantrum was underway. Under these con- 
ditions, the frequency of tantrums and 
atavisms declined continuously in the ex- 
perimental room until they all but disap- 
peared. Severe tantrums and attempts at 
self-destruction still occurred when sud- 
den changes in the conditions of the 
experiment produced a sudden change in 
the direction of nonreinforcement of the 
child’s performances. Severe changes in 
the reinforcement contingencies of the 
experiment produced a much larger reac- 
tion in the autistic than in the normal 
child. Consequently, we learned to change 
experimental conditions very slowly, so 
that the frequency of reinforcement re- 
mained high at each stage of the experi- 
ment. Much of the atavistic behavior of 
the autistic child is maintained because of 
its effect on the listener. 


REINFORCING STIMULI 


The reinforcers maintaining the autistic 
child’s performance are difficult to deter- 
mine without explicit experimentation. 
Small changes in the physical environ- 
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ment as, for example, direct stimulation 
of the mouth, splashing water, smearing a 
sticky substance on the floor, breaking a 
toy, or repeated tactile sensations, appear 
to sustain the largest part of the autistic 
child’s repertoire. Nevertheless, these may 
be weak reinforcing stimuli which appear 
to be strong, because the response pro- 
duces its reinforcement continuously and 
because alternative modes of responding 
are also maintained by weak reinforcers. 
The durability and effectiveness of a re- 
inforcer can usually be determined best 
by reinforcing the behavior intermittently 
or by providing a strong alternative which 
could interfere with the behavior in ques- 
tion. In the controlled experiments with 
autistic children, most of the conse- 
quences we supplied to sustain the chil- 
dren’s performance, such as color wheels, 
moving pictures, music, and so forth, were 
very weak reinforcers compared with food 
or candy. Food generally appeared to be 
an effective reinforcer, and most of the 
performances associated with going to the 
dining room and eating are frequently in- 
tact. In contrast, the normal children 
could sustain very large amounts of be- 
havior through the nonfood reinforce- 
ments. It is difficult to guess the potential 
effectiveness of new reinforcers, because 
the estimate depends upon some perform- 
ance being maintained by that reinforcer. 

In the everyday activities of the autistic 
children, little behavior was sustained by 
conditioned or delayed reinforcers. But, in 
a controlled experimental situation, such 
activities could be sustained by explicit 
training. For example, (a) The sound of 
the candy dispenser preceding the delivery 
of candy served as a conditioned rein- 
forcer. The fine-grain effects of the sched- 
ules of reinforcement show this. The 
difference in performance produced by 


two different schedules of reinforcement 
could have occurred only if the effective 
reinforcer were the sound of the magazine 
rather than the delivery of a coin. The 
actual receipt of the coin or food is much 
too delayed to produce the differences in 
performances under the two schedules 
without the conditioned reinforcer com- 
ing instantly after a response. (b) With 
further training, the delivery of a coin 
(conditioned reinforcer) sustained the 
child’s performances. The coin, in turn, 
could be used to operate the food or non- 
food devices in the experimental room. 
(c) Still later, coins sustained the child’s 
performance even though they had to be 
held for a period of time before they could 
be cashed in. The child worked until he 
accumulated five coins, then he deposited 
them in the reinforcing devices. (d) Even 
longer delays of reinforcement were ar- 
ranged by sustaining behavior in the ex- 
perimental room with a conditioned rein- 
forcer as, for example, a towel or a life 
jacket which could be used later in the 
swimming pool or in water play after the 
experimental session terminated. The ex- 
perimental development of these perform- 
ances shows that, even though the usual 
autistic repertoire is generally deficient in 
performances sustained by conditioned re- 
inforcement and with delay in reinforce- 
ment, the children are potentially capable 
of developing this kind of control. 

Little of the autistic child’s behavior is 
likely to be maintained by generalized re- 
inforcement, that is, reinforcement which 
is effective in the absence of any specific 
deprivation. A smile or parental approval 
are examples. The coins delivered as rein- 
forcements in the experimental room are 
potentially generalized reinforcers, since 
they make possible several performances 
under the control of many different dep- 
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rivations. However, we do not know 
whether the coin has actually acquired the 
properties of a generalized reinforcer. 


Srrmutus CONTROL OF BEHAVIOR 


It is very difficult to determine the 
stimulus and perceptual repertoire of au- 
tistic children. When a child responds to 
a complex situation, it is not usually clear 
what aspect of the situation is controlling 
the child’s behavior. In most cases, it is 
difficult to determine to what extent these 
children can respond to speech discrimi- 
natively, since the situations are usually 
complex and many stimuli may provide 
the basis for the simple performances. 
Similarly with visual repertoires. Con- 
trolled experiments showed unequivocally 
that behavior can come under the control 
of simple stimuli when differential effects 
of the performances were correlated with 
the different stimuli. When a coin was 
deposited in a lighted coin slot, it oper- 
ated the reinforcing device. Coins de- 
posited in unlighted slots were wasted. 
The children soon stopped putting coins 
in the unlighted slots. The previously de- 
veloped stimulus control broke down 
completely when these stimuli were 
placed in a more complicated context, 
however. A new vending machine was 
installed with eight columns, eight coin 
lights, and eight coin slots, so the child 
could choose a preferred kind of candy. 
The slight increase in complexity dis- 
rupted the control by the coin light, and 
it took several months and many experi- 
mental procedures before the stimulus 
control was reestablished. A better de- 
signed procedure, in view of the minimal 
perceptual repertoire of these children, 
would have been a gradual program by 
which variations in the specific dimen- 
sions of the coin slot and coin light were 


changed while the reinforcement contin- 
gency was held constant in respect to the 
essential property. 

In summary, the repertoire of the au- 
tistic child is an impoverished one. Little 
is known about the perceptual repertoire, 
but the available evidence suggests that it 
is minimal. The absolute amount of ac- 
tivity is low, but this deficit is even more 
profound if the specific items of activity 
are evaluated in terms of whether they 
are maintained by significant effects on a 
social or even nonsocial environment. 
Most of the child’s performances are of a 
simple sort, such as rubbing a spot of gum 
back and forth, softening and twisting a 
crayon, pacing, or flipping a shoelace. 
Those performances in the child’s reper- 
toire having social effects frequently do so 
because of their effects on the listener as 
aversive stimuli. Atavisms and tantrums 
are frequent. 


The Emergence of Performance Deficits 
during the Early Development 
of the Autistic Child 


Having characterized the autistic child’s 
repertoire, the next step is to determine 
the kinds of circumstances in the early life 
of these children which could bring about 
the behavioral deficits. The general plan 
is to state how the major behavioral 
processes and classes of variables can dras- 
tically reduce the frequency of occurrence 
of the various behaviors in the repertoire 
of any organism. Then, the parental en- 
vironment will be examined to determine 
circumstances under which the actual con- 
tingencies applied by the parental environ- 
ment to the child’s behavior could weaken 
the child’s performance similarly. The 
datum is the frequency of occurrence of 
all of the acts in the child’s repertoire, and 
the independent variables are the conse- 
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quences of these acts on the child’s en- 
vironment, particularly the parental en- 
vironment. All of the terms in such a 
functional analysis are actually or poten- 
tially directly observable and manipulable. 
In general, the performances in the child’s 
repertoire will be simultaneously a func- 
tion of many factors, each contributing to 
changes in the frequency of the relevant 
performances. It is important, therefore, 
to consider relative changes in frequency 
rather than simple presence or absence of 
various performances. The datum is the 
frequency of occurrence of the behavior. 
In the same vein, singly identifiable fac- 
tors may be interrelated and functioning 
simultaneously. 

The major paradigm for describing the 
behavior of an organism is to specify the 
consequences of the act (reinforcement) 
which are responsible for its frequency. In 
this sense, the major cause of an instance 
of behavior is the immediate effect on the 
environment (reinforcement). The con- 
tinued emission of the verbal response 
“Toast” depends on its effect on the par- 
ent in producing toast. Every known be- 
havioral process influencing the frequency 
of a positively reinforced performance is 
relevant to the problem of defining condi- 
tions under which we may produce a be- 
havioral deficit. Given the variables which 
maintain it, a performance may be weak- 
ened by their absence or by changing the 
order of magnitude. It is perhaps surpris- 
ing to discover that large behavioral defi- 
cits are plausible without any major appeal 
to punishment or suppression of behavior 
by aversive stimuli. 


INTERMITTENT REINFORCEMENT 
AND EXTINCTION 


Intermittent reinforcement and extinc- 
tion are the major techniques for remov- 
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ing or weakening behavior in a repertoire. 
The most fundamental way to eliminate 
a kind of behavior from an organism’s 
repertoire is to discontinue the effect the 
behavior has on the environment (extinc- 
tion). A performance may also be weak- 
ened if its maintaining effect on the 
environment occurs intermittently (inter- 
mittent reinforcement) .* Behaviors occur- 
ring because of their effects on the parent 
are especially likely to be weakened by in- 
termittent reinforcement and extinction, 
because the parental reinforcements are 
a function of other variables and behav- 
ioral processes usually not directly under 
the control of the child. The reinforce- 
ment of the verbal response, “Give me 
the book,” may go unreinforced because 
of many factors which determine the 
behavior of the listener. He may be pre- 
occupied, listening to someone else, dis- 
inclined to reinforce, momentarily inat- 
tentive, etc. In contrast, the physical 
environment reinforces continuously and 
reliably. Reaching for a book is usually 
followed by the tactile stimulation from 
the book. Verbal behavior, particularly, 
depends entirely for its development and 
maintenance on reinforcements supplied 


1 The reader may suggest at this point 
an apparent contradiction with the fact 
that extinction after intermittent reinforce- 
ment is more prolonged than after continu- 
ous reinforcement. This aspect of intermit- 
tently reinforced behavior’s durability is 
not a general proposition, however, and 
does not hold for behavior which is still 
being maintained. Behavior reinforced in- 
termittently will, in general, be emitted 
less frequently and be more easily weak- 
ened by emotional factors, changes in 
deprivation, punishment, and physiologi- 
cal disturbances than continuously rein- 
forced behavior. 
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by an audience (usually a parent). Be- 
cause of the possibility of prolonged 
extinction and infrequent, intermittent 
reinforcement, speech and social behavior 
are the most vulnerable aspects of the 
child’s repertoire. The young child is par- 
ticularly vulnerable to the extinction and 
intermittent reinforcement occurring in 
social reinforcement because only the 
parental environment mediates nearly all 
of the major reinforcers relevant to his 
repertoire. Large parts of the child’s reper- 
toire are reinforced by first affecting a 
parent who in turn produces the reinforcer 
for the child. The 2-year-old child who 
asks for a cookie from a parent and gets 
no response usually has no alternative 
audience who will reinforce this vocal be- 
havior. The result will either be the ex- 
tinction of the child’s verbal behavior or 
the reinforcement of nonvocal verbal 
forms when the child produces a cookie 
by a tantrum from which the parent 
escapes by giving the cookie. 


Factors IN THE PARENTAL REPERTOIRE 
AFFECTING THE FREQUENCY 
OF REINFORCEMENT 
OF THE CHILD’s PERFORMANCES 


To find the conditions under which the 
child’s repertoire will be weakened, there- 
fore, we must look for conditions influenc- 
ing the parents’ behavior, which will alter 
the parental performances, in turn provid- 
ing reinforcement of the child’s perform- 
ances. These might be: 

1. The general disruption of the 
parental repertoire. Any severe disruption 
of the parental repertoire will severely 
affect the frequency with which the par- 
ent reinforces the behavior of the child. 
Consider, for example, the depressed par- 
ent whose general level of behavior is very 
low. One consequence of this low level of 


behaving will be a lessened frequency of 
reacting to the child. Therefore, many 
items in the child’s repertoire will be less 
frequently reinforced in the depressed 
than the normal parent. The verbal re- 
sponses, “May I have some bread” or “I 
want to go outside,” might go unrein- 
forced or be emitted many times without 
reinforcement. Various kinds of somatic 
disturbances, such as alcoholic “hang- 
over,” drug addiction, severe headache, 
somatic diseases, etc., could also produce 
large changes in the over-all reactivity of 
the parent to a child. To the extent that 
the child’s performances occur because 
of their effect on the parent, the severely 
weakened parental repertoire may corre- 
spondingly weaken the child’s behavior. If 
the parental extinction of the child’s be- 
havior is systematic and periodic, much 
of a child’s behavior could be eliminated. 

2. Prepotency of other performances. 
Whether or not a parent reinforces a 
child’s performance also depends upon 
the alternative repertoire available to the 
parent. For example, the parent who is 
absorbed in various kinds of activities 
such as housecleaning, a home business, 
social activities and clubs, active telephon- 
ing, and so forth, may at various times 
allow many usually reinforced perform- 
ances to go unreinforced. In general, the 
likelihood of omitting reinforcement 
would depend upon the strength of the 
prepotent repertoire. As an example of a 
prepotent repertoire, the housewife ab- 
sorbed in a telephone conversation will 
not be inclined to answer a child or com- 
ply with a request. Housecleaning might 
be another repertoire controlling some 
parents’ behavior so strongly that it is pre- 
potent over behavior in respect to the 
child. In both cases, the essential result 
is the nonreinforcement of the child’s be- 
havior in competition with the prepotent 
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parental repertoire. Mothers of autistic 
children often appear to have strong reper- 
toires prepotent over the child. This may 
be at least a partial reason why mothers of 
autistic children are so often well-edu- 
cated, verbal, and at least superficially 
adequate people. 

3. A third factor producing intermit- 
tent reinforcement of the child’s behavior 
is related to the first two factors listed 
above. If the parent finds other reinforcers 
outside of the home more rewarding than 
dealing with the child, the child becomes 
an occasion on which the significant ele- 
ments of the parental repertoire cannot be 
reinforced. A parent changing diapers, or 
otherwise taking care of a child, cannot 
telephone a friend, be out socializing, be 
on a job, or doing whatever the autistic 
mother finds rewarding. The child ac- 
quires the properties of a conditioned 
aversive stimulus because it is an occasion 
which is incompatible with the parents’ 
normal repertoire. This is of course the 
major method of aversive control in hu- 
man behavior—the discontinuation of 
positive reinforcement, Another basis for 
establishing the child as a conditioned 
aversive stimulus to the parent is the 
emergence of atavisms and a large degree 
of aversive control of the parent by the 
child. To the extent that the parent is 
reinforced by escaping from the child be- 
cause of his conditioned aversive proper- 
ties, the frequency of the parental rein- 
forcement of the child’s behavior is further 
reduced. 

The development of the atavistic be- 
havior in the child by the parent is neces- 
sarily a very gradual program in which the 
beginning steps involve small magnitudes 
of behavior such as whining, whimpering, 
and crying. As the parent adapts to these 
or becomes indifferent to them because of 
the prepotence of other kinds of activity, 
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then progressively larger orders of magni- 
tude become reinforced. The large-magni- 
tude tantrūm may be approximated or 
“shaped” by gradual differential reinforce- 
ment. The parents of one autistic child, 
for example, at one period took turns all 
night standing in the child’s room because 
one step out of the room would immedi- 
ately produce a severe tantrum in the 
child. When the child functions as a con- 
ditioned aversive stimulus for the parent, 
the parent is less likely to reinforce the 
child’s behavior positively. This lack of 
positive reinforcement, in turn, empha- 
sizes the atavistic responses on the child’s 
part as the major mode of affecting the 
parent. 

The usual limiting factor in preventing 
excessive development of tantrums is the 
emergence of self-control on the part of 
the parent in escaping from the aversive 
control by the child rather than reinfore- 
ing it. Here, again, the repertoire of the 
parent is relevant. The development of 
self-control requires a highly developed 
repertoire which depends for its develop- 
ment on the ultimate aversive conse- 
quences of the child’s control of the par- 
ent. The child’s control becomes more 
aversive to the parent if it interrupts 
strong repertoires. Specifically, a parent 
engrossed in a conversation will find a 
child’s interruption more aversive than a 
parent who is simply resting. If, in fact, 
there is no strong behavior in the parent, 
then the child’s control is not likely to be 
aversive, and there is no basis for develop- 
ing self-control. 

All three of the above factors—over-all 
disturbances in the parental repertoire, 
prepotent activities, and escape from the 
child because of his aversiveness—reduce 
the amount of parental reinforcement of 
the child’s performances. The over-all ef- 
fect of the nonreinforcement on the rep- 
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ertoire of the child will depend upon the 
length of time and number of items of the 
child’s repertoire that go unreinforced, as 
well as the existence of other possible so- 
cial environments that can alternatively 
maintain the child’s behavior (see below). 


DIFFERENTIAL REINFORCEMENT 
or Aravistic Forms or BEHAVIOR 
BY THE PARENT 


The schedule by which the parent re- 
acts to the child is also relevant to the 
development of atavistic behavior. Ini- 
tially, a tantrum may be an unconditioned 
consequence of parental control as, for 
example, sudden nonreinforcement or 
punishment. Eventually, however, the 
child’s tantrums may come to be main- 
tained by their effect on the parental 
environment, because they present an 
aversive situation that can be terminated 
if the parent supplies some reinforcer to 
the child. The reinforcer presented by the 
parent to escape from the aversive conse- 
quences of the tantrum also increases the 
subsequent frequency of atavistic re- 
sponses. 

The effect on the parent of the given 
form and intensity of tantrums will vary 
from time to time, depending on the con- 
ditions maintaining the parents’ behavior. 
This variation in sensitivity of the parent 
to aversive control by the child results in 
a variable-ratio schedule of reinforcement 
of the child’s tantrum by the parent—a 
schedule of reinforcement potentially ca- 
pable of maximizing the disposition to 
engage in tantrums. This is the schedule 
of reinforcement that produces the high 
frequencies of performances as in gam- 
bling (10). The sensitivity of the parent 
to aversive control by the child will de- 
pend on the general condition of the 
parental repertoire as discussed above. 


The same factors in the parental reper- 
toire that tend to produce nonreinforce- 
ment of the child’s behavior—general 
disruption of the parent or other behav- 
iors prepotent over the child—corre- 
spondingly produce reinforcement of 
large-order-of-magnitude tantrums. The 
parent whose total repertoire is severely 
enough disrupted to interfere with the 
normal reinforcement of the child’s be- 
havior will also react only to tantrums 
that are of large order of magnitude of 
aversiveness. A range of sensitivity of the 
parent to aversive control by the child 
produces ideal conditions for progressively 
increasing the intensity or frequency of 
tantrums. A high sensitivity to aversive 
control guarantees that some tantrums 
will be reinforced at least periodically. A 
low sensitivity differentially reinforces 
tantrums of large orders of magnitude. At 
one extreme, the parent may be hyper- 
sensitive to the child and, at other times, 
so depressed that only physical violence 
will produce a reaction. The schedule by 
which the parent’s behavior terminates 
the tantrum is a second factor which will 
increase the range of reactivity of the 
parent. As more behavior is required of 
the parent to terminate the tantrum, the 
parent’s inclination to do so will fall. 
When the parent is less inclined to rein- 
force a given intensity of tantrum, any 
variation in tantrum intensity is tanta- 
mount to differential reinforcement of 
extreme forms, if the parent now reacts to 
the larger-order-of-magnitude tantrum. 
How much the parent differentially re- 
inforces tantrums in the child depends, in 
part, upon the child’s other positively re- 
inforced repertoires. When, for example, 
a child’s performance suddenly goes un- 
reinforced, as when a parent may refuse a 
request, the likelihood and severity of a 
tantrum will in part depend on the par- 
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ent’s ability to “distract” the child. This, 
in turn, depends upon whether alternative 
modes of behavior are in fact available to 
the child. When conditions are present 
for the progressive reinforcement of more 
and more severe tantrums, the process is 
potentially non self-limiting. Autocatalysis 
is likely to occur, particularly if the parent 
has little disposition to reinforce the gen- 
eral items in the child’s repertoire for 
reasons other than terminating the aver- 
sive demands of the child. 


NonsocraL REINFORCERS 


Some of the child’s behavior is main- 
tained by his direct effect on the physical 
environment without the intervention of 
other individuals. In general, very small 
effects on the environment will sustain 
performances with which the parent usu- 
ally has little reason to interfere. For ex- 
ample, the child plays with his own shoe- 
lace, moves his fingers in his own visual 
field, emits minimal nonverbal, vocal re- 
sponses, and so forth. Larger effects on the 
physical environment as, for example, 
moving objects about the house, speaking 
to the parent, playing with toys, touching 
and handling usual household objects, are 
more likely to enter upon the parental 
repertoire and so may produce a response 
whose effect is to discontinue the behavior 
or interfere with its reinforcement. The 
punishment aspect of the parental inter- 
ference with the child’s activities will be 
dealt with separately below. The relative 
possibility of parental interference and 
nonreinforcement of the hierarchy of per- 
formances may account for the large part 
of the autistic child’s repertoire, which 
consists of behaviors having small, limited 
effects on the physical environment. Occa- 
sionally, even behaviors that are main- 
tained by the most simple effects on the 
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environment are extinguished or punished 
when they occur in the presence of a par- 
ent. For example, the father of one 
autistic child reports that the child 
reached for a chandelier while he was 
holding him. The father instantly dropped 
the child, with a reaction of considerable 
disapproval because “You should pay at- 
tention to me when you're with me.” 
Aside from the secondary effect on the 
child, the immediate result of the incident 
is the nonreinforcement of the child 
reaching for a common physical object. 

The existence of “nonverbal” vocal be- 
havior in some autistic children may be 
related to forms of vocal behavior with 
which the parent will or will not interfere. 
Vocal behavior maintained by its effect 
on a parent (verbal) is susceptible to 
weakening by parental extinction. A par- 
ent interferes less easily with vocal be- 
havior maintained by its direct effect 
(nonverbal) comparable with making 
noise by rubbing a stick over a rough sur- 
face. Further, such nonverbal vocal re- 
sponses can emerge readily at any stage of 
the child’s life, unlike verbal behavior, be- 
cause it does not depend on a generalized 
reinforcement. 


FAILURE TO DeveLor CONDITIONED 
AND GENERALIZED REINFORCERS 


The normal repertoire of the child con- 
sists almost entirely of sequences of be- 
havior that are maintained, in a chain or 
sequence, by conditioned and generalized 
reinforcers (10). An example of a chain 
of responses would be the behavior of the 
child moving a chair across the room and 
using it to climb to a table top to reach a 
key which in turn opens a cupboard con- 
taining candy. This complicated sequence 
of behavior is linked together by critical 
stimuli which have the dual function of 
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sustaining the behavior they follow (con- 
ditioned reinforcement) and setting the 
occasion for the subsequent response. The 
chair in the above example is an occasion 
on which climbing onto it will bring the 
child into a position where reaching for 
food on the table top will be reinforced 
by obtaining food. Once this behavior is 
established, the chair in position in front 
of the table may now be a reinforcer, and 
any of the child’s behavior which results 
in moving the chair into position will be 
reinforced because of the subsequent role 
of the chair in the later chain of behaviors. 
A minimal amount of behavior is neces- 
sary before a chain of responses can de- 
velop. The development of the control by 
the various stimuli in the chain, both as 
discriminative stimuli setting the occasion 
for the reinforcement of behavior and as 
reinforcers, depends upon a high level of 
activity, so that the responses will occur 
and come under the control of the stimuli. 
This is even more true for the develop- 
ment of the generalized reinforcer. When 
the child has moved enough objects about 
the house and achieved a variety of effects 
on his environment relative to a range of 
deprivations and reinforcers, simply ma- 
nipulating the physical environment may 
become a reinforcer without reference to a 
specific level of deprivation. This, * of 
course, is the uniquely human reinforcer 
that makes possible much of verbal be- 
havior, education in general, and self- 
control. Again, large amounts of behavior 
—many chains of behavior with many 
different kinds of conditioned reinforcers 
—are a necessary condition for the emer- 
gence of a generalized reinforcer. To the 
extent that the child’s repertoire becomes 
weakened by intermittent reinforcement 
and extinction, as mentioned above, and 
punishment and aversive control (see 


below), the possibility of the develop- 
ment of generalized reinforcers, and 
hence more complex behavior, becomes 
less and less likely. Parental “attention” 
is probably one of the most important 
generalized reinforcers normally main- 
taining the child’s behavior. Parental at- 
tention is an occasion upon which the 
child’s performances may have an impor- 
tant effect on the parent. Inattention is 
an occasion on which the child’s responses 
are likely to have little effect. Hence, the 
parents’ performances in smiling, saying, 
“Right,” “Good boy,” or “Thank you,” all 
come to function as conditioned rein- 
forcers. Their emergence as generalized 
reinforcers again depends upon the exist- 
ence of a large behavioral repertoire. A 
large number of chains of responses will 
produce important positive effects when 
the parent smiles or says, “Good boy.” 
Lower frequencies of reinforcement follow 
for these same activities when the parent 
is frowning or says, “Bad boy.” 

Any large reduction in the child’s over- 
all performance will interfere with the 
initial development of conditioned rein- 
forcers or their continued effectiveness. 
The control by the environment over the 
child’s behavior depends first upon the 
emission of the behavior. This follows 
from the manner in which the environ- 
ment comes to control the child’s per- 
formance: the successful execution of an 
act on one occasion, coupled with the un- 
successful act in its absence. Until a child 
climbs on chairs, as in the previous ex- 
ample, a chair has little chance of becom- 
ing a discriminative stimulus. Without 
the development of stimulus control, con- 
ditioned reinforcers cannot develop. The 
reinforcing effect of the chair in the above 
example depends upon its being the occa- 
sion on which further performances may 
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be reinforced. In this way, a low general 
level of behavior may impede the enlarge- 
ment of the child’s repertoire because it 
does not allow stimulus control and in 
turn prevents reinforcement of new be- 
havior. A limited development of simple 
conditioned reinforcers in turn prevents 
the development of a generalized rein- 
forcer. Parental responses, such as smiling, 
“Good,” or “Right,” can have little effect 
on the child if there is not a history by 
which many different forms of the child’s 
performance have produced various rein- 
forcers on these occasions. Without pa- 
rental generalized reinforcement, educa- 
tional processes and positive parental con- 
trol are all but impossible. This control is 
normally carried out by the use of praise 
and parental attention, coupled with mild 
forms of threats of discontinuing the rein- 
forcers. Even after a generalized reinforcer 
has acquired its function, its continued 
effectiveness depends on the various 
stimuli continuing to stand in a significant 
relation to the child’s performance. The 
actual form of the parents’ generalized 
reinforcer is not nearly as important as the 
parents’ subsequent reinforcement prac- 
tices with the child. The reinforcing ef- 
fects of the smile derive from the rein- 
forcing practices associated with it. A 
smile usually functions as a generalized 
reinforcer in most people because a smil- 
ing person is more likely to reinforce. The 
correlation between smiling and reinforce- 
ment is by no means inevitable, however. 
Some individuals may be more disposed to 
punish than reinforce when smiling in 
some situations. In a similar vein, if the 
child has no behavior in his repertoire that 
will be more likely to be reinforced on the 
occasion of a parental smile, it matters 
little what the parent’s reinforcing prac- 
tices are when smiling as against when 
frowning. 
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Stimulus Control 


The specific occasions on which a 
child’s performances have their charac- 
teristic effects on the environment will 
subsequently determine whether the child 
acts. In the absence of the characteristic 
circumstances under which the behavior is 
normally reinforced, the child will be less 
disposed to act in proportion to the degree 
of similarity with the original situation. 
Changing a stimulus to one which has not 
been correlated with reinforcement is an- 
other way of weakening a repertoire. New 
stimuli also elicit emotional responses and 
general autonomic effects that may inter- 
fere with established performances. Here, 
simply repeated exposure to the stimuli 
may produce adaptation to the stimuli and 
eliminate their emotional effects. Ordi- 
narily, the infants’ performances are under 
the control of a limited range of stimuli, 
usually one or two parents in a limited 
part of a specific home environment. The 
discriminative repertoire broadens as the 
child grows older and other individuals 
come to be occasions on which his per- 
formances have significant effects. ‘The 
parental environment of the very young 
child narrows the control of the child’s 
performance to a limited range of stimuli, 
largely because the parent mediates almost 
all of the important events affecting the 
child. A major factor which brings the 
child’s behavior more narrowly under the 
control of the parent is the nonreinforce- 
ment of much of the child’s behavior in 
the absence of the parent. The close con- 
trol of the child’s behavior by the parent 
weakens the child’s repertoire in the ab- 
sence of a parent much more when there 
has been explicit differential reinforce- 
ment than when there has been simply a 
limited reinforcing environment. 
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Sudden shifts in the child’s environ- 
ment may or may not produce major 
performance deficits. At one extreme, a 
sudden shift of the stimuli in the child’s 
controlling environment will have little in- 
fluence if the child already has been rein- 
forced on the occasion of a wide range of 
circumstances and individuals. At another 
extreme, a repertoire can be eliminated 
almost completely if the child has had a 
history in which major kinds of perform- 
ances have gone unreinforced except on 
the occasion of a single person in a specific 
environment. The sudden shifts in the 
situations and persons controlling the 
child’s behavior may occur under a variety 
of circumstances, such as a sudden change 
in a constant companion, death of a par- 
ent, or a sudden shift in the physical en- 
vironment. A sudden shift in the environ- 
ment of one of the subjects reported in 
the previously mentioned experiment 
could conceivably have been the major 
factor in her autistic development. Many 
of the activities of the child’s mother were 
prepotent over dealing with the child, and 
she solved the problem by hiring a teen- 
age baby sitter as a constant companion 
and nursemaid, After a year, the baby sitter 
left, suddenly and abruptly, leaving the 
child with the mother. Within four 
months, the child began to behave less in 
general, lost speech, and showed increas- 
ing frequency of atavisms. The child’s 
repertoire possibly was under such close 
control of the baby sitter that the very 
sudden change to the mother created an 
environment which in the past had been 
correlated with nonreinforcement. If the 
child’s behavior were under very narrow 
control by the baby sitter, because of the 
nonreinforcement on all other occasions, 
a sudden shift, as in the loss of the baby 
sitter, could produce a dramatic deficit in 
the child’s repertoire. 


Disruptive EFFECT or SUDDEN STIMULUS 
CHANGES AND THE AMOUNT, DURABILITY, 
AND RANGE OF BEHAVIOR 


A novel reinforcing environment will 
not sustain a child’s performance unless 
the repertoire contains behavior of a suff- 
cient range and durability. The new en- 
vironment weakens the performance be- 
cause it nearly always requires slightly 
different forms of behavior. For example, 
a new person entering a child’s home is 
not so likely to respond successfully to the 
incompletely developed verbal behavior of 
a child as the parent. The possibility of 
the child’s affecting the stranger will de- 
pend upon his having verbal responses 
different from those usually reinforced by 
the parent and, also, durable verbal be- 
havior that will continue to be emitted 
under the intermittent reinforcement that 
is likely to occur. If the child’s repertoire 
is durable and extensive enough so that 
the verbal response may be repeated sev- 
eral times and supplemented by auxiliary 
behavior, the child has a greater chance of 
affecting the new person or of being 
shaped by him. Similarly with other kinds 
of social behavior. The wider the range of 
behavior and the greater the disposition to 
emit it the more likely that the child’s 
performance will be within the range of 
responses potentially reinforcible by the 
new environment. 

For a stimulus to acquire control over 
behavior, the child must first emit be- 
havior in the presence of the stimulus. 
Consider, for example, the performance of 
a child at a children’s party at which there 
are lots of toys and games, such as bicycles, 
swings, and so forth. The likelihood of the 
child’s behavior coming under the control 
of any of the other children as reinforcers 
is minimal if the new environment sup- 
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presses or makes the child’s entire reper- 
toire unavailable because it is a novel 
stimulus and is an occasion on which the 
child’s behavior has never been reinforced. 
If the behavior of playing with a swing or 
riding a tricycle is sufficiently strong that 
it may be emitted even under the adverse 
conditions of the very strange party en- 
vironment, then the simple emission of 
the previously developed behavior pro- 
vides a situation under which other chil- 
dren at the party may potentially reinforce 
or otherwise affect the child’s repertoire. 
Simply the acts of eating cake, candy, or 
ice cream, or picking up a toy put some of 
the child’s behavior under the control of 
the new environment. Each new perform- 
ance which can potentially occur at the 
party provides a basis for the child’s rein- 
forcing some behavior of other children at 
the party or of his coming under the con- 
trol of the other children’s reinforcers. On 
the other hand, a sudden exposure to a 
new environment with a weak and narrow 
repertoire may produce a severe behavioral 
deficit. In any case, the child will be much 
less disposed to go to the party if he had 
behaved unsuccessfully in the new en- 
vironment. This lower disposition to at- 
tend and engage in the party would in 
turn make it less likely that the child will 
emit behavior that would be reinforced 
in the party environment. 


ADAPTATION 


The emotional and elicited autonomic 
effects of novel environments may also 
interfere with a child’s performances. 
Adaptation to new environments occurs 
with gradual exposure. A sudden exposure 
to a new environment will produce gross 
emotional and autonomic responses which 
will in turn interfere with, or even com- 
pletely suppress, the emission of possible 
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operant behavior potentially reinforcible 
by the new environment. The rate at 
which the child is exposed to the new en- 
vironments will determine the magnitude 
of disturbance. Exposure to a new environ- 
ment and adaptation of the emotional 
responses do not necessarily create the 
potential basis for responding, however. 
A repertoire that will make contact with 
the new environment is aiso necessary. 


Amount OF Prior NONREINFORCEMENT 


The more closely controlled the child’s 
performances are by specific stimuli, the 
more likely a sudden shift in the environ- 
ment will produce a cessation of respond- 
ing. For example, the child receiving 
minimal care from a parent probably will 
be less affected by a sudden shift in en- 
vironment than a child closely affected 
and controlled by parental response. It is 
paradoxical that the parent who responds 
sensitively to the child’s performance may 
be potentially weakening it more than the 
parent who exerts little control over the 
child. It is the alternate reinforcement 
and nonreinforcement that place the 
child’s behavior narrowly under the con- 
trol of very specific stimuli so that it is 
much more vulnerable to sudden changes. 
The range of stimuli in whose presence 
the child’s behavior goes unreinforced 
will determine the narrowness of the 
stimulus control. 


Cumulative Effects of a Behavioral 
Deficit 


The continuous development of more 
and more complex forms of a child’s be- 
havior is normally achieved because the 
parents and community approximate the 
required performances. At each stage of 
the child’s development, the community 
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reinforces the child’s current repertoire 
even though it is more disposed to react 
to small increments in the child’s per- 
formance in the direction of the required 
complex performances. Should any of the 
above processes produce a deficit in per- 
formance or an arrest in the development 
of the child’s performance, further devel- 
opment of a repertoire would depend 
upon the community’s relaxing its require- 
ments and reinforcing performances in an 
older child that it normally accepts only 
from a younger one. Ordinarily, the rein- 
forcing practices of the community are 
based on the chronological age and physi- 
cal development of the child. 

Only between the ages of 114 to 4 years 
does the parent have sufficient control of 
the child to weaken his performance to 
the degree seen in infantile autism. This 
is a critical period in the child’s develop- 
ment during which his behavior is espe- 
cially susceptible to extinction, because 
the traditional social pattern in the usual 
family restricts the child’s experience to 
one or two parents. Before the age of 114, 
the child has few performances with 
which the parent will interfere or that 
have important effects on the parent. 
Much of the infant’s behavior is main- 
tained by simple and direct effects on its 
environment. As the child approaches 2 
years, the rapid development of a be- 
havioral repertoire, particularly social and 
verbal behavior, makes possible extinction 
and other forms of weakening. The effec- 
tiveness of the parental environment in 
weakening the child’s repertoire depends 
upon the availability of concurrent audi- 
ences for the child’s behavior. In general, 
the 2-year-old child is limited to the home 
and comes into increasing contact with 
other environments as he grows older, 
perhaps reaching a maximum at school 
age. The presence of an older sibling 


might appear to preempt the possibility 
of a sufficient degree of isolation to ac- 
count for an aversive behavioral deficit. 
A sibling could provide an alternative to 
the parent as a reinforcing environment. 
The behavioral or functional influence of 
a sibling would depend on the amount 
and nature of interaction between the 
children. For example, an older child 
might possibly completely avoid the 
younger one or tend to have the same 
patterns of reaction as the parent. In many 
cases, the older sibling has playmates out- 
side the home to the complete exclusion 
of the younger child. The older sibling, in 
many circumstances, punishes as well as 
extinguishes the younger child for any at- 
tempted participation in his play. There 
are very few facts as to the exact nature of 
the interactions in most cases. 

The parent as the sole maintainer of the 
child’s behavior is perhaps even more 
likely when the child is raised in a rural or 
isolated community, and perhaps with 
one of the parents largely absent. The 
above analysis suggests that a survey of 
severely autistic children would, in gen- 
eral, show them to be first-born children; 
or, if other siblings were available, they 
would have provided little interaction with 
the child. It also suggests that the child 
would be raised in a house physically or 
socially isolated from other families or 
children such that there were no alterna- 
tive social environments that could pro- 
vide reinforcement for the child’s be- 
havior. When the child was exposed to 
both parents, it would be expected that 
both parents were consistent in their non- 
reinforcement of the child’s performances. 


Aversive Control and Punishment 


It has been possible to describe condi- 
tions which might produce major be- 
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havioral deficits without dealing with pun- 
ishment or aversive control. A similar ac- 
count might present a functional analysis 
of how performance deficits might occur 
as a result of aversive control. Many 
writers have already described some of 
these factors by extending general princi- 
ples of aversive control to human be- 
havior (7, 8, 11). For the purposes of the 
analysis presented in this paper, I should 
like to restrict the discussion of aversive 
control to its relation to positive reinforce- 
ment. Much of human aversive control is 
carried out by discontinuing or withdraw- 
ing reinforcement (3, 10). For example, a 
frown or criticism may function as an 
aversive stimulus because these are occa- 
sions on which reinforcements are less 
likely to occur. Even when corporal pun- 
ishment is given, it is not clear as to 
whether the resulting effect on the child’s 
behavior is due to a slap or to the lower 
inclination of a punishing parent to rein- 
force. Most parents who spank a child 
will be indisposed to act favorably toward 
the child for some period of time subse- 
quently. As a result, one major by-product 
of frequent punishment may be a larger 
order of interference with the child’s nor- 
mal repertoire along the lines of the posi- 
tive reinforcement deficits described 
above, 

The obvious effectiveness of punish- 
ment in some kinds of human control 
appears to contradict experimental find- 
ings with animals which show punish- 
ment to have only a temporary effect on 
behavior (1, 2, 9). The role of positive 
reinforcement factors helps resolve the 
dilemma. The effectiveness of punishment 
depends on how strongly the punished be- 
havior is maintained by positive reinforce- 
ment. The apparent effectiveness of pun- 
ishment in the control of children may 
occur when weak repertoires are punished 
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or when the punishment indirectly pro- 
duces extinction. Most animal experi- 
ments using electric shock as an aversive 
stimulus have used strongly maintained 
positively reinforced operant behavior as 
the base-line performance to be punished. 
The aversive control might be more effec- 
tive when the performances to be pun- 
ished are less strongly maintained. 


Conclusion 


As might be expected from the rela- 
tively low frequency of infantile autism, 
the combination of circumstances hypoth- 
esized above would occur only rarely. The 
above hypothesis provides a framework 
for investigating the circumstances sur- 
rounding the development of the autistic 
child. All of the variables that might 
weaken the behavior of a child are directly 
or potentially observable. The data re- 
quired are the actual parental and child 
performances and their specific effects on 
each other, rather than global statements 
such as dependency, hostility, or sociali- 
zation. Not all of the factors responsible 
for a child’s performance may be present 
currently. Using retrospective accounts, 
however, makes it difficult to determine 
the actual correspondence between the 
verbal statements of the parent and their 
actual practices in raising the child. The 
alternatives are, first, an objective assess- 
ment of the child’s repertoire in a wide 
enough range of environments so as to 
allow an assessment of the nature of the 
environmental control of the child’s cur- 
rent behavior; and, second, actual home 
observations of the specific social conse- 
quences of the child’s performances early 
in the development of the disease. 

The same kind of functional analysis 
can be made for the performance of the 
adult psychotic although the specific defi- 


cits observed in autistic children and their 
manner of occurrence may not be rele- 
vant. In particular, the analysis of the 
adult’s behavior would be more concerned 
with the factors which weaken behavior 
already in the repertoire rather than the 
development of new repertoires as with 
the analysis of the autistic child’s behav- 
ior. Maintaining already-established be- 
havior is more at issue in the adult than 
the initial development of a performance 
as in the case of the child (3). 
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chapter I xX 


Behavioral Treatment 


Acatn, in the area of behavioral modification for clinical purposes, the two 
learning approaches stemming from Hull and Skinner have been produc- 
tive. The application of a Hullian learning approach to problems of ab- 
normal behavior commenced first within the framework of traditional 
psychotherapy (for example, Dollard and Miller, 1950). More recently 
(Wolpe, 1958; Eysenck, 1960) new methods of treatment involving direct 
respondent conditioning have been evolved within this approach. On the 
other hand, at the present time in the United States, the strongest impetus 
in the application of learning principles to clinical problems has stemmed 
from an operant conditioning framework. 

This section will be concerned with sampling some of the studies in 
which learning principles have been applied to behavioral modification in 
applied settings in a manner which has implications for treatment pro- 
cedures, The first article by Ayllon and Michael is a very convincing 
demonstration of the relevance of operant conditioning principles and 
methods, In this study various problem behaviors of hospitalized psychotic 
patients are “cured” through the manipulation of reinforcement variables. 
In this series of treatments for various patients, such principles as extinc- 
tion, satiation, negative reinforcement, and positive reinforcement are 
utilized, The results indicated that the bizarre behaviors of the psychotic 
functioned according to the usual principles of learning, contrary to the 
conception of many people. Furthermore, the study supports the sugges- 
tion made in the last chapter that many of these unusual and inappropriate 
behaviors are being shaped up and maintained within the hospital situation 
by the conditions of learning which apply in these settings. 

As discussed fully as a general problem in Selection 13, when one is 
interested in training programs involving complex human behaviors—which 
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means long-term training—one important problem is that of an adequate 
reinforcing system. It is noteworthy that the basic training which the child 
receives occurs when the trainers, the parents, have a very powerful and 
durable system of reinforcers. In the typical mental hospital, however, the 
patients receive all the primary reinforcers which are requisite—not con- 
tingent upon any type of behavior. ‘This being the case, unless the patient 
has a strongly developed system of conditioned social reinforcers, it would 
be expected there would be little means with which to maintain strong 
(motivated) learning behaviors. Ayllon and Haughton show how food may 
be used as a strong reinforcer in the neuropsychiatric setting, first to main- 
tain eating behavior to more and more exacting demands. Then, among 
other things, the situation was changed so that various simple social behav- 
iors were requisite. In these demonstrations the required behavior was 
actually reinforced by a token which enabled the patient to gain access to 
the dining hall. 

The success of these training procedures has far reaching implications. It 
suggests that through use of an extensive token system, such as described 
in different contexts in previous chapters (for example, Staats, 1963, in 
Chapter III), it should be possible to construct training programs dealing 
with behaviors significant to adjustment for the treatment of psychotic 
patients. For many of these patients the use of more usual conditioned 
social reinforcers would be ineffective. This study of Ayllon and Haughton 
also strongly supports the learning interpretation of abnormal behavior. 

The next article by Isaacs, Thomas, and Goldiamond is an account of 
how an important deficit in behavior may be rectified through the use of 
operant methods. Through successive approximation training techniques 
the speech behavior of two mute schizophrenics is reinstated. This corrobo- 
rates the implications of the preceding study—that adjustive behaviors can 
be operantly conditioned in long standing psychoses through manipulating 
available reinforcers. An important elaboration of the implication is given 
by the fact that in the present study a significant complex human behavior 
of great adjustive value is involved. In the present case the reinforcers used 
were actually inexpensive and probably not very strong. This suggests that 
much more could be done where a more potent reinforcer system was used. 

Finally, it seems that the learning potentialities for both adjustive and 
maladjustive behaviors of even very deteriorated back-wards patients of 
many years standing has been sharply underrated. Much of the poor be- 
havioral repertoires which exist in such patients may be seen as the result 
of impoverished conditions within the hospital itself for the acquisition 
and maintenance of adjustive behavior. It might be added that, important 
as these studies are, they represent only a bare beginning in the potential 
development of reinforcer systems as well as in the application of these 
systems to the treatment of complex human behavior problems. 

The next article shows how disruptive behavior in a child may be treated 
through manipulating reinforcement conditions. In this case the parent’s 
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handling of the child had resulted in full-blown temper tantrums. Treat- 
ment consisted of withdrawing reinforcement for that behavior. 

The next article by Bandura summarizes some of the behavior principles 
which can be considered to be part of psychotherapy, some of the progress 
which has been made in the establishment of a general rationale for behav- 
ioral treatment within a learning framework, as well as some of the progress 
which must be made in establishing an integrated learning approach. 

Another indication of the way in which a behavioristic psychotherapy 
should be moving is indicated by the article by Ferster, Nurnberger, and 
Levitt. This article gives a more detailed analysis of one type of inappropri- 
ate behavior (overeating). The analysis involves many behavior principles 
and suggests an extensive treatment program. The behavior, its controlling 
stimuli, the effective reinforcers, and so on, are analyzed, and the possi- 
bilities for the manipulation of these variables in treatment are set forth. It 
is suggested that this type of analysis may be the prototype for the develop- 
ment of adequate learning programs for the treatment of various behavioral 
disorders. A complete analysis for each of the many behavior problems, 
supported by research, will eventually be necessary in the development of a 
behavioristic psychotherapy which will eventually have to include well- 
worked-out learning programs for each of the many problems of behavior. 


44, 
The Psychiatric Nurse as a Behavioral Engineer*’ 


The behavior which leads to a person’s 


Teodoro Ayllon? and Jack Michael 


admission to a mental hospital often in- 
volves danger to himself or others, with- 


* From T. Ayllon and J. Michael, The 
psychiatric nurse as a behavioral engineer, 
J. exp. anal. Behav., 2, 323-334 (1959). 
Reprinted by permission of the authors and 
the Journal of the Experimental Analysis 
of Behavior, 

1 This paper contains a portion of the 
data from a doctoral dissertation submitted 
to the Department of Psychology, Uni- 
versity of Houston, in partial fulfillment of 
the requirements for the Ph.D. degree, in 
August, 1959. Grateful acknowledgment 


drawal from normal social functions, or a 


dramatic change from his usual mode of 
behaving. The professional staff of the 


is due to the members of the doctoral 
committee for their help and encourage- 
ment, and also to Drs. H. Osmond and I. 
Clancey, Superintendent and Clinical Di- 
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psychiatric hospital directs its major ef- 
forts toward the discovery of the flaw in 
the patient’s mental apparatus which pre- 
sumably underlies his disturbing and dan- 
gerous behavior. Following the medical 
paradigm, it is presumed that once the 
basic disfunction has been properly iden- 
tified the appropriate treatment will be 
undertaken and the various manifesta- 
tions of the disfunction will disappear. 

While diagnosis is being made and dur- 
ing subsequent treatment, the patient is 
under the daily care of the psychiatric 
nurses? in the ward. There, he often ex- 
hibits annoying and disrupting behavior 
which is usually regarded as a further 
manifestation of his basic difficulty. This 
behavior is sometimes identical with that 
which led to his admission; but at other 
times it seems to originate and develop 
within the hospital setting. Although it is 
still regarded as a reflection of his basic 
problem, this disruptive behavior may be- 
come so persistent that it engages the full 
energies of the nurses, and postpones, 
sometimes permanently, any effort on 
their part to deal with the so-called basic 
problem. 

Disrupting behaviors usually consist in 
the patient’s failure to engage in activi- 
ties which are considered normal and 
necessary; or his persistent engagement 
in activities that are harmful to himself 
or other patients, or disrupting in other 
ways. For example, failures to eat, dress, 
bathe, interact socially with other pa- 
tients, and walk without being led are 
invariably disruptive. Hoarding various 
objects, hitting, pinching, spitting on 
other patients, constant attention-seeking 


3As used in this paper, “psychiatric 
nurse” is a generic term including all those 
who actually work on the ward (aides, 
psychiatric nurses, and registered nurses). 


actions with respect to the nurses, upset- 
ting chairs in the dayroom, scraping paint 
from the walls, breaking windows, stuffing 
paper in the mouth and ears, walking on 
haunches or while in a squatting position 
are disruptive when they occur frequently 
and persistently. 

At present, no systematic approach to 
such problems is available to the nurses. 
A psychodynamic interpretation is often 
given by psychiatrists and psychologists; 
and, for that matter, the nurses some- 
times construct “depth” interpretations 
themselves. These interpretations seldom 
suggest any specific remedial actions to 
the nurses, who then have no other re- 
course than to act on the basis of common 
sense, or to take advantage of the physical 
therapy in vogue. From the point of view 
of modern behavior theory, such strong 
behaviors, or behavioral deficits, may be 
considered the result of events occurring 
in the patient’s immediate or historical 
environment rather than the manifesta- 
tions of his mental disorder. The present 
research represents an attempt to discover 
and manipulate some of these environ- 
mental variables for the purpose of modi- 
fying the problem behavior. 


Research Setting 


The research was carried out at the 
Saskatchewan Hospital, Weyburn, Sas- 
katchewan, Canada. It is a psychiatric 
hospital with approximately 1500 patients. 
Its most relevant features in terms of the 
present experiment are: 

1. The nurses are trained as psychiatric 
nurses in a 3-year program. 

2. They are responsible for the patients 
in their wards and enjoy a high degree of 
autonomy with respect to the treatment 
of a patient. The psychiatrists in the hos- 
pital function as advisers to the nursing 


THE PSYCHIATRIC NURSE AS A BEHAVIORAL ENGINEER 


staff. This means that psychiatrists do not 
give orders, but simply offer advice upon 
request from the psychiatric nurses. 

3, The nurses administer incoming and 
outgoing mail for the patients, visitor traf- 
fic, ground passes, paroles, and even dis- 
charge, although the last is often carried 
out after consultation with a psychiatrist. 
The nurses also conduct group therapy 
under the supervision of the psychiatric 
staff. 

The official position of the senior au- 
thor, hereafter referred to as E, was that 
of a clinical psychologist, who designed 
and supervised operant-conditioning 
“therapy” as applied by the nurses. Once 
his advice had been accepted, the nurses 
were responsible for carrying out the pro- 
cedures specified by E. It was the privilege 
of the nurses to discontinue any treatment 
when they believed it was no longer nec- 
essary, when they were unable to imple- 
ment it because of lack of staff, or when 
other ward difficulties made the treatment 
impossible. Whenever termination be- 
came necessary, E was given appropriate 
notice, 


Subjects 


The subjects used in this investigation 
were all patients in the hospital. Of the 
total 19 patients, 14 had been classified 
as schizophrenic and 5 as mentally defec- 
tive. Except for one female patient who 
was resident for only 7 months, all pa- 
tients had been hospitalized for several 
years. Each subject presented a persistent 
behavior problem for which he had been 
referred to E by the nursing staff. None 
of the Ss was presently receiving psycho- 
therapy, electroconvulsive therapy, or any 
kind of individual treatment. 

The behaviors which were studied do 
not represent the most serious problems 
encountered in a typical psychiatric hos- 
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pital. They were selected mainly because 
their persistence allowed them to survive 
several attempts at altering them. 


Procedure 


Prior to a systematic observational study 
of the patient’s behavior the nurses were 
asked about the kind and frequency of 
naturally occurring reinforcement ob- 
tained by the patient, the duration and 
frequency of the problem behavior, and 
the possibility of controlling the rein- 
forcement. Next, a period of systematic 
observation of each patient was under- 
taken prior to treatment. This was done to 
obtain objective information on the fre- 
quency of the behavior that was a problem 
to the nurses, and to determine what 
other behaviors were emitted by the pa- 
tient. 

Depending on the type of behavior, two 
methods were used for recording it. If the 
behavior involved interaction with a 
nurse, it was recorded every time it oc- 
curred. Entering the nurses’ office, and 
eating regular meals are examples of such 
behavior. 

Behavior which did not naturally in- 
volve contact with the nurse was recorded 
by a time-sampling technique. The nurse 
who was in charge of the program was sup- 
plied with a mimeographed record form. 
She sought out the patient at regular inter- 
vals; and without interaction with him, 
she recorded the behavior taking place at 
that time. She did not actually describe 
the behavior occurring, but rather clas- 
sified it in terms of a pre-established 
trichotomy: (a) the undesirable behavior, 
(b) incompatible behavior which could 
ultimately displace the undesirable be- 
havior; and (c) incompatible behavior 
which was not considered shapeable, such 
as sleeping, eating, and dressing. (Al 
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though these latter acts are certainly sus- 
ceptible to the influence of reinforcement, 
they were regarded as neutral behaviors in 
the present research.) The period of ob- 
servation varied from 1 to 3 minutes. After 
making an observation, the nurse resumed 
her regular ward activities until the next 
interval was reached, whereupon she again 
sought out the patient. Except for one 
patient, who was observed every 15 min- 
utes, such observations were made every 
30 minutes. 

The relevant aspect of the data ob- 
tained by the time-check recording is the 
proportion of the total number of obser- 
vations (excluding observations of neutral 
behavior) during which the patient was 
engaging in the behavior being altered. 
This will be called the relative frequency 
of the behavior. As an example, on the 
first day of the program of extinction for 
psychotic talk in the case of Helen (see 
below), 17 nonneutral behaviors were re- 
corded, Of these, nine were classed as 
psychotic talk and eight as sensible talk; 
the relative frequency of psychotic talk 
was 0.53. 

Although it would have been desirable, 
a long pretreatment period of observation 
was precluded by the newness of this 
approach and the necessity of obtaining 
the voluntary cooperation of the nurses. 

After the pretreatment study had been 
completed, E instructed the ward nurses 
in the specific program that was to be 
carried out. In all cases the instruction was 
given at ward meetings and usually in- 
volved the cooperation of only two shifts, 
the 7 a.m. to 3 p.m., and 3 p.m. to 11 p.m, 
since the patients were usually asleep dur- 
ing the 11 p.m. to 7 am. shift. 

The pretreatment studies indicated that 
what maintained undesirable behavior in 
most of the patients was the attention or 
social approval of the nurses toward that 


behavior. Therefore, the emphasis in in- 
structing the nursing staff was on the op- 
eration of giving or withholding social 
reinforcement contingent upon a desired 
class of behavior. What follows illustrates 
the tenor of E’s somewhat informal in- 
structions to the nurses. “Reinforcement 
is something you do for or with a patient, 
for example, offering candy or a cigarette. 
Any way you convey attention to the 
patient is reinforcing. Patients may be 
reinforced if you answer their questions, 
talk to them, or let them know by your 
reaction that you are aware of their pres- 
ence. The common-sense expression ‘pay 
no attention’ is perhaps closest to what 
must be done to discourage the patient’s 
behavior. When we say ‘do not reinforce 
a behavior,’ we are actually saying ‘ignore 
the behavior and act deaf and blind when- 
ever it occurs.’ ” 

When reinforcement was given on a 
fixed-interval basis, the nurse was in- 
structed to observe the patient for about 
1 to 3 minutes at regular intervals, just as 
in the pretreatment observation period. If 
desirable behavior was occurring at the 
time of observation, she would reinforce 
it; if not, she would go on about her 
duties and check again after the next inter- 
val had passed. Strictly speaking, this is 
fixed interval with a limited-hold contin- 
gency (Ferster & Skinner, 1957). During 
a program of extinction the nurse checked 
as above; however, instead of reinforcing 
the patient when he exhibited the behav- 
ior being altered, she simply recorded it 
and continued her other work. Except for 
specific directions for two patients, the 
nurses were not given instructions on the 
operation of aversive control. 

The programs requiring time-sample ob- 
servations started after breakfast (around 
9 am.) and ended at bedtime (around 
9 p.m.), and were usually carried out by 


THE PSYCHIATRIC NURSE AS A BEHAVIORAL ENGINEER 


only one of the 6 to 12 nurses on each 
shift. Because of the daily shift changes, 
the monthly ward rotations, and a system- 
atic effort to give everyone experience at 
this new duty, no patient’s program was 
followed by any one nurse for any consid- 
erable length of time. Nineteen, as a mini- 
mum, different nurses were involved in 
carrying out each patient’s program. Over 
100 different nurses participated in the 
entire research project. 

Most social ward activities took place 
in the dayroom, which was a large living 
room containing a television set, card 
tables, magazines, and games. It was here 
that reinforcement was given for social 
behaviors toward patients, and for non- 
social behaviors which were strengthened 
to compete with undesirable behaviors. 
The fact that the research was carried out 
in five wards distributed far from each 
other in a four-floor building made it im- 
possible for E to observe all the nurses 
involved in the research at any one time. 
Because of the constant change in nursing 
personnel, most of E’s time was spent in 
instructing new people in the routines of 
the programs. In addition, since E did not 
train the nurses extensively, he observed 
them, often without their knowledge, and 
supervised them in record keeping, admin- 
istering reinforcement, extinction, etc. 
That the nurses performed effectively 
when E was absent can be at least partially 
determined by the ultimate results. 


Results 


The results will be summarized in 
terms of the type of behavior problem and 
the operations used in altering the behay- 
ior. In general, the time required to 
change a specific behavior ranged from 6 
to 11 weeks. The operations were in force 
for 24 hours a day, 7 days a week. 
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STRONG BEHAVIOR TREATED BY 
EXTINCTION, oR EXTINCTION COMBINED 
WITH REINFORCEMENT 
FOR INCOMPATIBLE BEHAVIOR 


In the five cases treated with this pro- 
gram, the reinforcer was the attention of 
the nurses; and the withholding of this 
reinforcer resulted in the expected decline 
in frequency. The changes occurring in 
three of the behavior problems, scrubbing 
the floor, spending too much time in the 
bathroom, and one of the two cases of 
entering the nurses’ offices, were not com- 
plicated by uncontrollable variables. Lu- 
cille’s case is presented in detail as repre- 
sentative of these three. The interpretation 
of the changes occurring in the other two 
behavior problems, entering the nurses’ 
offices, and psychotic verbal behavior, is 
not so clearcut. Helen’s case illustrates 
this point. For details concerning the 
cases not discussed in this paper, see 
Ayllon (1959). 


Lucille 


Lucille’s frequent visits to the nurses’ 
office interrupted and interfered with their 
work. She had been doing this for 2 years. 
During this time, she had been told that 
she was not expected to spend her time 
in the nurses’ office. Frequently, she was 
taken by the hand or pushed back bodily 
into the ward. Because the patient was 
classified as mentally defective, the nurses 
had resigned themselves to tolerating her 
behavior. As one of the nurses put it, “It's 
difficult to tell her anything because she 
can’t understand—she’s too dumb.” 

The following instructions were given 
to the nurses: “During this program the 
patient must not be given reinforcement 
(attention) for entering the nurses’ office. 
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Tally every time she enters the office.” 
The pretreatment study indicated that 
she entered the office on an average of 16 
times a day. As Fig. 1b shows, the average 
frequency was down to two entries per 
day by the seventh week of extinction, 
and the program was terminated. Figure 
la shows the same data plotted cumula- 
tively. 


Helen 


This patient’s psychotic talk had per- 
sisted for at least 3 years. It had become 
so annoying during the last 4 months prior 
to treatment that other patients had on 
several occasions beaten her in an effort 
to keep her quiet. She was described by 
one of the psychiatrists as a “delusional” 
patient who “feels she must push her 
troubles onto somebody else, and by doing 
this she feels she is free.” Her conversa- 
tion centered around her illegitimate child 
and the men she claimed were constantly 
pursuing her. It was the nurses’ impression 
that the patient had “nothing else to talk 
about.” 

A 5-day pretreatment observation of the 
patient was made at 30-minute intervals 
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to compare the relative frequencies of psy- 
chotic and sensible content in her talk. 
Some of the nurses reported that, previ- 
ously, when the patient started her psy- 
chotic talk, they listened to her in an 
effort to get at the “roots of her problem.” 
A few nurses stated that they did not 
listen to what she was saying but simply 
nodded and remarked, “Yes, I under- 
stand,” or some such comment, the pur- 
pose of which was to steer the patient's 
conversation onto some other topic. These 
reports suggested that the psychotic talk 
was being maintained by the nurses’ reac- 
tion to it. While it is recognized that a 
distinction between psychotic and normal 
talk is somewhat arbitrary, this case was 
included in the research because of its 
value as a problem involving primarily ver- 
bal behavior. 

The following instructions were given 
to the nurses: “During this program the 


FIG. 1. Extinction of the response “en- 
tering the nurses’ office”; a. cumulative 
record, b. conventional record. From 
Ayllon and Michael: The psychiatric 


nurse as a behavioral engineer. 
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patient must not be given reinforcement 
(attention) for her psychotic talk (about 
her illegitimate child and the men chasing 
her). Check the patient every 30 minutes, 
and (a) tally for psychotic talk; and (b) 
reinforce (and tally) sensible talk. If an- 
other patient fights with her, avoid mak- 
ing an issue of it. Simply stop the other 
patient from hurting her, but do so with 
a matter-of-fact attitude.” 

The 5-day observation period resulted 
in a relative frequency of psychotic talk 
of 0.91. During treatment (Fig. 2), the 
relative frequency dropped to less than 
0.25; but, later on, it rose to a value ex- 
ceeded only by the pretreatment level. 
The sudden increase in the patient’s psy- 
chotic talk in the ninth week probably 
occurred because the patient had been 
talking to a social worker, who, unknown 
to the nurses, had been reinforcing her 
psychotic talk. The reinforcement ob- 
tained from the social worker appeared to 
generalize to her interaction with other 
patients and nurses. The patient herself 
told one of the nurses, “Well, you’re not 
listening to me. I'll have to go and see 
Miss (the social worker) 
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again, “cause she told me that if she 
would listen to my past she could help 
me.” 

In addition to the reinforcement at- 
tributable to the social worker, two other 
instances of bootleg reinforcement came 
to light. One instance occurred when a 
hospital employee came to visit the ward, 
and, another, when volunteer ladies came 
to entertain the patients. These occasions 
were impossible to control, and indicate 
some of the difficulties of long-term con- 
trol over verbal behavior. 

It is of interest to note that since the 
reinforcement program began, the patient 
has not been attacked by the other pa- 
tients and is only rarely abused verbally. 
These improvements were commented 
upon by the nurses, who were neverthe- 
less somewhat disappointed. On the basis 
of the improvement shown in verbal be- 
havior, the nurses had expected a dramatic 
over-all change which did not occur. 


FIG. 2. Extinction of psychotic talk. From 
Ayllon and Michael: The psychiatric 
nurse as a behavioral engineer. 
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STRONG BEHAVIOR TREATED 
BY STRENGTHENING 
INCOMPATIBLE BEHAVIOR 


This case represented an attempt to 
control violent behavior by strengthening 
an incompatible class of responses, and to 
recondition normal social approaches 
while the violence was under control. The 
first phase was quite successful; but errors 
in strategy plagued the last half of the 
program, and it was terminated by the 
nurses because the patient became more 
violent. 

The immediate reason for referral was 
that the patient, Dotty, had become in- 
creasingly violent over the last 5 years, and 
recently attacked several patients and hos- 
pital personnel without any apparent rea- 
son. Since admission and up to the pres- 
ent, she had received many electroconvul- 
sive-therapy treatments aimed at reducing 
this violence, with little or no success. In 
1947, a physician recommended her as a 
good case for psychosurgery. In Decem- 
ber of the same year, she attempted to 
strangle her mother who was visiting her 
at the time. In July 1948, the patient had 
a leucotomy. The situation had recently 
become so serious that at the least sus- 
picious move on her part the nurses would 
put her in the seclusion room. She spent 
from 3 to 12 hours daily in that room. 

A 5-day pretreatment study, at 15-min- 
ute intervals, indicated that one of the 
nonviolent behaviors exhibited fairly 
often was “being on the floor” in the 
dayroom. The response included lying, 
squatting, kneeling, and sitting on the 
floor. Strengthening this class of responses 
would control the violence and, at the 
same time, permit the emotional behavior 
of other patients and nurses toward her 
to extinguish. To strengthen the patient’s 


own social behavior, her approaches to the 
nurses were to be reinforced. The re- 
sponse “approach to nurse” was defined 
as spontaneous requests, questions or 
comments made by the patient to the 
nurse. Ultimately, the plan was to discon- 
tinue reinforcing being on the floor once 
the patient-nurse social interaction ap- 
peared somewhat normal. Presumably, 
this would have further increased the 
probability of approach to the nurses. 

For the duration of the program, con- 
tinuous social reinforcement was to be 
available for her approach to the nurses. 
Social reinforcement was to be available 
for the first 4 weeks only, on a fixed inter- 
val of 15 minutes, contingent on the re- 
sponse being on the floor. For the last 4 
weeks, social reinforcement was to be 
withheld for being on the floor. 

The following instructions were given 
to the nurses for the first 4 weeks of the 
program: “Reinforce (and tally) her ap- 
proaches to you every time they occur. 
Check the patient every 15 minutes, and 
reinforce (and tally) the behavior being 
on the floor.” 

From the fifth week on the instructions 
were modified as follows: “Continue rein- 
forcing (and tallying) her approaches to 
you every time they occur. Check the pa- 
tient every 15 minutes, and tally but do 
not reinforce the behavior being on the 
floor.” 

During the period of reinforcement, as 
shown in Fig. 3, the relative frequency of 
the response being on the floor increased 
from the pretreatment level of less than 
0.10 to a value of 0.21. During the suc- 
ceeding 4 weeks of extinction, the `fre- 
quency of being on the floor returned to 
the pretreatment level. 

It was clear that being on the floor was 
incompatible with the fighting behavior 
and that the latter could be controlled by 
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reinforcing the former. During the period 
of reinforcement for being on the floor, 
she attacked a patient once; but during 
the period of extinction, she made eight 
attacks on others. Her approaches to 
nurses increased over-all during the 4 
weeks of reinforcement, but they de- 
creased during the last 4 weeks, even 
though they were still being reinforced. 
This decrease paralleled the decrease in 
being on the floor. While being on the 
floor was undergoing extinction, attacks 
on the patients and nurses increased in 
frequency, and the nurses decided to re- 
tum to the practice of restraining the 
patient. The program was terminated at 
this point. 

The patient’s failure to make the transi- 
tion from being on the floor to approach- 
ing the nurses suggests that the latter 
response was poorly chosen. It was rela- 
tively incompatible with being on the 


FIG. 3. Reinforcement and subsequent 
extinction of the response “being on the 
floor.” From Ayllon and Michael: The 
psychiatric nurse as a behavioral en- 
gineer. 


floor. This meant that a previously rein- 
forced response would have to be extin- 
guished before the transition was possible, 
and this, too, was poor strategy with a 
violent patient. 


WEAK BEHAVIOR STRENGTHENED 
BY ESCAPE 
AND AVOIDANCE CONDITIONING 


Two female patients generally refused 
to eat unless aided by the nurses. One, 
Janet, had to be forcefully taken to the 
dining room, where she would permit the 
nurses to spoonfeed her. The other patient, 
Mary, was spoonfed in a room adjacent to 
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the dining room. Both patients had little 
social contact with others and were re- 
ported to be relatively indifferent to at- 
tention by the nurses. Both were also 
reported to care only for the neat and 
clean appearance of their clothing. Mary 
had been at the hospital for 7 months, and 
Janet had been there for 28 years. These 
two patients were in different wards and 
apparently did not know each other. 

The program involved a combination 
of escape and avoidance conditioning, 
with food spilling as the aversive stimu- 
lus. All spoonfeeding was to be accom- 
panied by some food spilling which the 
patient could escape by feeding herself 
after the first spilling, or avoid by feeding 
herself the entire meal. Social reinforce- 
ment was to be given contingent on 
feeding herself. 

Tt was hoped that once self-feeding be- 
gan to occur with some regularity, it 
would come under the control of environs 
mental variables which maintain this 
behavior in most people, such as conveni- 
ence, social stimulation at meal time, etc. 
In both cases, the program ultimately 
resulted in complete self-feeding, which 
now has been maintained for over 10 
months. Janet’s behavior change was com- 
plicated by a history of religious fasting, 
and her change took a little longer. Mary’s 
case will be given here in detail. 

The following instructions were given 
to the nurses: “Continue spoonfeeding 
the patient; but from now on, do it in 
such a careless way that the patient will 
have a few drops of food fall on her dress, 
Be sure not to overdo the food dropping, 
since what we want to convey to the pa- 
tient is that it is difficult to spoonfeed a 
grown-up person, and not that we are 
mean to her. What we expect is that the 
patient will find it difficult to depend on 
your skill to feed her. You will still be 
feeding her, but you will simply be less 


efficient in doing a good job of it. As the 
patient likes having her clothes clean, she 
will have to choose between feeding her- 
self and keeping her clothes clean, or be- 
ing fed by others and risking getting her 
clothes soiled. Whenever she eats on her 
own, be sure to stay with her for a while 
(3 minutes is enough), talking to her, or 
simply being seated with her. We do this 
to reinforce her eating on her own. In the 
experience of the patient, people become 
nicer when she eats on her own.” 

During the 8-day pretreatment study, 
the patient ate 5 meals on her own, was 
spoonfed 12, and refused to eat 7. Her 
weight at this time was 99 pounds, Her 
typical reaction to the schedule was as 
follows: the nurse would start spoonfeed- 
ing her; but after one or two “good” 
spoonfuls, the nurse would carelessly drop 
some food on her dress. This was con- 
tinued until either the patient requested 
the spoon, or the nurse continued spoon- 
feeding her the entire meal. The behav- 
iors the patient adopted included (a) 
reaching for the spoon after a few drops 
had fallen on her dress; (b) eating com- 
pletely on her own; (c) closing her mouth 
so that spoonfeeding was terminated; or 
(d) being spoonfed the entire meal. Upon 
starting the schedule, the most frequent 
of all these alternatives was the first; but 
after a while, the patient ate on her own 
immediately. The relevant data are shown 
in Fig. 4. On the 12th day, the patient 
ate all three meals on her own for the 
first time. Four meals were refused out of 
the last 24: one meal was missed because 
she stated she didn’t like “liver” and the 
other three because she said she was not 
hungry. Her weight when she left the 
hospital was 120 pounds, a gain of 21 
pounds over her pretreatment weight. 

Mary’s relapse in the fifth week, after 
she had been eating well for 2 weeks, was 
quite unexpected. No reasonable explan- 
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ation is suggested by a study of her daily 
records; but, after she had been spoonfed 
several meals in a row, the rumor devel- 
oped that someone had informed the 
patient that the food spilling was not acci- 
dental. In any event, the failure to feed 
herself lasted only about 5 days. 

Since the patient’s hospital admission 
had been based on her refusal to eat, ac- 
companied by statements that the food 
was poisoned, the success of the program 
led to her discharge. It is to be noted that 
although nothing was done to deal di- 
rectly with her claims that the food was 
poisoned, these statements dropped out 
of her repertoire as she began to eat on 
her own. 


Srronce BEHAVIOR WEAKENED 
THROUGH A COMBINATION 
OF EXTINCTION FOR SOCIAL ATTENTION 
AND STIMULUS SATIATION 


For 5 years, several mentally defective 
patients in the same ward, Harry, Joe, 
Tom, and Mac, had collected papers, rub- 
bish, and magazines and carried these 
around with them inside their clothing 


FIG. 4. Escape and avoidance condition- 
ing of self-feeding. From Ayllon and 
Michael: The psychiatric nurse as a be- 
havioral engineer. 


next to their body. The most serious of- 
fender was Harry, whose hoarding resulted 
in skin rashes. He carried so much trash 
and so persistently that for the last 5 years 
the nurses routinely “dejunked” him sev- 
eral times during the day and before he 
went to bed. ` 

An analysis of the situation indicated 
that the patient’s hoarding behavior was 
probably maintained by the attention he 
derived because of it and by the actual 
scarcity of printed matter. There were few 
papers or magazines in the ward. Some 
were brought in occasionally; but since 
they were often torn up and quickly dis- 
appeared, the nurses did not bring them 
in very often. 

It was expected that flooding the ward 
with magazines would decrease the hoard- 
ing behavior after the paradigm of satia- 
tion. Similarly, the availability of many 
magazines was expected to result in their 
being the major object of hoarding. The 
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latter would facilitate an easier measure- 
ment of this behavior. 

In addition, social reinforcement was to 
be withheld for hoarding magazines and 
rubbish. The results for all patients were 
essentially similar: a gradual decrease in 
hoarding. After 9 weeks of satiation and 
extinction, the program was terminated, 
since hoarding was no longer a problem. 
This improvement has been maintained 
for the last 6 months. 

The following instructions were given 
to the nurses: “During this program the 
patients Harry, Mac, Joe, and Tom must 
not be given reinforcement (attention ) 
for hoarding. There will be a full supply 
of magazines in the dayroom. Every night, 
after all patients have gone to bed, re- 
plenish the magazine supply in the day- 
toom. Every night while the patients are 
in bed, check their clothes to record the 
amount of hoarding. Do not, however, 
take their hoarding from them.” 

The original plan was to count the 
number of magazines in the patients’ 
clothing after they had gone to bed. This 
is, in fact, the dependent variable shown 
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FIG. 5. Satiation and extinction of two 
forms of magazine hoarding. From Ayllon 
and Michael: The psychiatric nurse as a 
behavioral engineer. 


in Fig. 5 for Joe, Tom, and Mac. The 
recording for Harry had to be changed, 
however; after 4 days of the program, he 
no longer carried the rubbish or magazines 
in his clothing. Instead, he kept a stack 
of magazines on his lap while he was sit- 
ting in the dayroom. The number of mag- 
azines in his stack was counted when he 
left the dayroom for supper, and this is 
the dependent variable shown for Harry 
in Fig. 5. (Mac was out of the ward for 
3 weeks because of illness.) 

Prior to the program, one of the nurses 
questioned the possibility and even ad- 
visability of changing Harry’s behavior. 
Her argument was that “behavior has its 
roots in the personality of the individual. 
The fact that he hoards so much indicates 
that Harry has a strong need for security. 
I don’t see how we are going to change 
this need, and I also wonder if it is a good 
thing to do that.” This was a point of 
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view commonly encountered, especially 
regarding relatively nonverbal patients. 

It would seem in this case that Harry 
transferred his security needs from hoard- 
ing rubbish and magazines to sitting in 
the dayroom and looking at magazines, 
especially during T.V. commercials. The 
transfer occurred with no apparent signs 
of discomfort on his part. 


OTHER CASES 


Combinations of extinction, reinforce- 
ment, and avoidance programs were set up 
for three patients; in two of these the 
problem behavior was eliminated in only 
a few weeks. The program of the third 
patient was followed for 20 days and then 
terminated since he had shown no 
changes by that time. An interpretation 
of the outcome of each of these programs 
is rendered questionable by the number 
of controlling variables involved and the 
nature of the changes. 

The pretreatment study of four addi- 
tional patients showed that the problem 
behavior of three of them did not occur 
often enough to justify carrying through 
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a program; and in the fourth case, no 
easily controllable variables were available 
and, again, no program was undertaken. 


DISCUSSION 


On the basis of this work, further re- 
search along the same lines is now under 
way.t The present results are presented in 
this preliminary form in the hopes that 
they will provide encouragement to those 
who are in a position to conduct similar 
research. . . . 
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45. 
Control of the Behavior of 
Schizophrenics by Food** 


Teodoro Ayllon? and Eric Haughton? 


Operant-conditioning principles using 
food as a reinforcer were applied to control 
the behavior of 45 chronic schizophrenic 
patients. The investigation was conducted 
in a psychiatric ward in which there was 
24-hr environmental control. 

In order to use food as a reinforcer for 
controlling psychotic behavior, it was neces- 
sary first to deal with the eating deficits in 
the patients. Approximately 50% of the 
ward population was selected because of a 
history of refusal to eat. Their refusal to eat 
had remained relatively unaffected by one 
or more of these treatments: spoonfeeding, 
tubefeeding, intravenous feeding, and elec- 


* From T. Ayllon and E. Haughton, Con- 
trol of the behavior of schizophrenics by 
food, J. exp. anal. Behav., 5, 343-352 
(1962). Reprinted by permission of the 
authors and the Journal of the Experi- 
mental Analysis of Behavior. 

1 This report is based, in part, on a 2- 
year research project conducted at the 
Saskatchewan Hospital, Weyburn, Sas- 
katchewan, Canada, and supported by a 
grant from the Commonwealth Fund. 
Grateful acknowledgment is due to H. 
Osmond and I. Clancey of the Saskatche- 
wan Hospital for making the research pos- 
sible at this institution. The advice and 
criticisms of J. Michael, I. Goldiamond, 
and N. Azrin are also greatly appreciated. 


troshock. These treatments were discon- 
tinued, and the patients were left alone at 
mealtimes. The results show that social re- 
inforcement in such forms as coaxing, per- 
suading, and feeding the patient ‘tend to 
shape patients into eating problems so they 
are conditioned to eat only with assistance. 
When refusal to eat was no longer followed 
by social reinforcement, the patients soon 
started eating unassisted. When access to 
the dining room was made dependent upon 
a chain of responses including a motor and 
social component, all patients learned these 
responses. 


Attempts to control the behavior of 
schizophrenic patients have relied heavily 
on the use of reinforcers such as candy, 
cigarettes, and money (Lindsley, 1956; 
King, et al., 1957; Hutchinson & Azrin, 
1961). To improve the limited effective- 
ness of these reinforcers, Lindsley (1956) 
studied the reinforcing characteristics of a 
wide range of stimuli. For example, he 
has used such reinforcers as religious pic- 
tures, auditory feedback, and music. 
These reinforcers have proved to be effec- 
tive for some individuals, but not appro- 
priate for general use. In research with 
humans, a powerful reinforcer is greatly 


2 Now at Behavior Research Laboratory, 
Anna State Hospital, Anna, Illinois. 

3 Now at Psychological Laboratories, 
Harvard University, Cambridge, Massa- 
chusetts. 
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needed which will have general applica- 
tion irrespective of such variables as age, 
intelligence, or psychological deficits, One 
such reinforcer is food. 

The advantages of using food as a rein- 
forcer are self-evident. Indeed, the control 
of psychotic behavior may be made more 
effective by making food contingent 
upon desired behaviors. Since most exper- 
imenters are keenly aware of the possibili- 
ties of food as a reinforcer one may well 
wonder why it has not been used. The 
most probable reason is the administra- 
tive difficulties encountered in controlling 
food in the patient’s environment. 

As part of a programmatic research in 
the development of techniques for the 
control of psychotic behavior, we at- 
tempted using food as a reinforcer. How- 
ever, in the planning stages of this in- 
vestigation, we learned that a number of 
schizophrenic patients refused food and 
required special treatments to prevent 
possible starvation. Therefore, attempting 
to use food as a reinforcer of general 
application seemed unreasonable. An in- 
quiry indicated that “eating problems” 
were often regarded as symptoms of the 
patient’s “mental condition.” Many of 
these patients exhibited delusions or 
made peculiar statements regarding food. 
For instance, some insisted the food was 
poisoned, others claimed God forbade 
them to eat, and so on. Frequently, a 
“dynamic” interpretation was found in 
the patient’s file to explain his refusal to 
eat. Other times, “psychotic intrusions” 
and lack of “reality contact” or “ego 
identification” were also advanced as ex- 
planations. All of these interpretations 
seemed to point to one conclusion: eating 
problems can be modified only if the pa- 
tient’s mental state is modified first. 

Refusal to eat is observed in most men- 
tal hospitals. The treatment varies from 
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hospital to hospital, and, indeed, from 
ward to ward. Often, a patient requires 
only a personal “reminder,” such as when 
the nurse looks for the patient at meal- 
times and lets him know that he had 
better go to the dining room to eat. Other 
times, the nurse takes the patient by the 
hand to eat. If the patient complains of 
the food being poisoned, the nurse may 
ingest a few spoonfuls and say, “Look, 
I’m eating the same food you have; you 
can see it is not poisoned.” If the pa- 
tient’s eating behavior remains unaltered, 
spoonfeeding, tubefeeding, intravenous 
feeding, and electroshock treatments are 
often used. Although the patient may 
start eating after any or all of these treat- 
ments, many patients do so only for short 
periods of time. Those patients who re- 
quire “constant supervision” are regarded 
as chronic eating problems. 

Such considerations form the back- 
ground for the problems concerning the 
schizophrenic’s eating behavior. Clearly 
then, we had to first determine if food 
alone would control normal eating behav- 
ior in schizophrenic subjects, including 
those patients known as chronic eating 
problems. Only then could we proceed to 
study the effects of food as a reinforcer. 


The Experimental Ward and Control 
over the Reinforcement 


This study was conducted in a mental 
hospital ward, to which only authorized 
personnel were allowed access. The din- 
ing room was the only place where food 
was available, and entrance to the dining 


4As used in this paper, “nurse” is a 
generic term, including all those who ac- 
tually work on the ward (attendants, aides, 
and psychiatric and registered nurses) . 
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room was under full experimental con- 
trol. Water was freely available at a drink- 
ing fountain on the ward. None of the 
patients had ground passes or jobs outside 
the ward. 


Experiment I: Control 
of Normal Eating Behavior 
of Schizophrenic Patients by Food 


SUBJECTS 


The Ss were 32 female patients in a 
mental hospital. Seven of these patients 
were selected solely because they were 
regarded as eating problems and because 
they were able to walk. Before they were 
admitted to the experimental ward, these 
patients had been spoonfed, tubefed, or 
given electroshock therapy when they re- 
fused to eat. The remaining 25 patients 
were selected at random from a popula- 
tion of long-standing schizophrenic pa- 
tients. The median for continuous hos- 
pitalization for all patients was 20 years. 
The median age for the group was 54 
years. The diagnostic categories for the 
patients were: 30 schizophrenics, 1 mental 
defective, and 1 patient suffering from 
involutional depression. 

No medications were given to 28 of the 
32 Ss during the investigation. Pheno- 
thiazine derivatives were administered to 
4 patients. 


PROCEDURE 


The traditional treatments for eating 
problems were discontinued. Patients 
were no longer coaxed, reminded, led, or 
escorted to eat. They were not spoonfed, 
tubefed or subjected to electroshock ther- 
apy. 

In order to bring eating behavior under 


the sole control of food, the nurses were 
kept away from the patients at mealtimes. 
In so doing, the social reinforcement in 
the form of attention and sympathy for 
refusal to eat was removed. If the patient 
was to eat a meal, she had to walk into 
the dining room without any coaxing, 
persuasion, or guidance from the nurses. 
To insure objectivity of recording, the 
response recorded was “entering the din- 
ing room.” Eating invariably followed 


this response; therefore, the terms eating 
and entering the dining room are used 
interchangeably. 

At mealtime, a time interval of 30 min 


was allowed for the patients to be ad- 
mitted to the dining room, Patients were 
not told of the time limit. A nurse called 
the meal and opened the dining room; 
and at the end of the 30-min interval, the 
door was locked and no patients were 
allowed to enter. 


REsuLts 


The eating problems of the schizo- 
phrenic patients were eliminated. As Fig. 
1 shows, the patients with eating prob- 
lems showed a low percentage of meals 
eaten upon the removal of all assistance 
for taking meals. These patients main- 
tained a stable percentage of eating when 
access to the dining room was limited to 
30 min. After 4 weeks, only 20 min of ac- 
cess to the dining room was allowed. 
Under this reduced access time, the 
patients still maintained a stable eat- 
ing behavior. Even when only 15 min 
of access time was allowed, the patients 
continued eating their meals. The time 
limit for entering the dining room was 
then reduced further to 5 min. Only 
under this stringent requirement did the 
patients show a slight temporary drop in 


CONTROL OF THE BEHAVIOR OF SCHIZOPHRENICS BY FOOD 


the percentage of meals eaten. The rest of 
the ward patients showed a similar sta- 
bility in the percentage of meals eaten, 
and also a slight drop when the time limit 
for access to meals was lowered to 5 min. 
The main difference between these two 
groups of patients lies in the overall per- 


centage of meals eaten. 
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FIG. 1. The unassisted eating by mental 
patients. All assistance, persuasion, and 
spoonfeeding at mealtimes were removed. 
Following meal call, access to the dining 
room was gradually reduced from 30 min 
to 20, to 15, and, finally, to 5 min. From 
Ayllon and Haughton: Control of the be- 
havior of schizophrenic patients by food. 


The eating behavior of two patients dif- 
fered somewhat from that of the rest of 
the patients. One patient stopped eating 
for 7 days, and then was given milk, con- 
centrated protein, and multivitamins in- 
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termittently. In time, she was maintained 
on a fluid diet of 1200 to 1500 calories 
per day, and received this at the same 
time other patients received medications. 
She was kept on this regimen for 110 
days, so that she lost 18% of her body 
weight. Thereafter, she started going to 
the dining room. Another patient who 
suffered from obesity stopped eating for 
15 days, drinking only water during this 
time. At the end of this fast, she had lost 
most of her excess weight (15% of the 
original weight). At this time, she re- 
sumed going to the dining room with all 
of the other patients. 


DISCUSSION 


These findings demonstrate that the 
control of the eating behavior of schizo- 
phrenic patients by food alone is feasible. 
Even patients who fasted for long periods 
eventually came under the control of 
food. . . . 

Neither psychiatric diagnosis nor body 
weight were related to the development 
of eating problems. For example, some 
schizophrenic as well as mental defective 
patients had a_ history of eating diffi- 
culties. Likewise, a subject weighing over 
200 pounds had a long history of refusing 
to eat, and so did a subject of 75 pounds. 
Fears concerning the imminent danger of 
starvation in lightweight subjects were 
unfounded. Both heavy and lightweight 
Ss eventually ate when refusal to eat was 
no longer followed by social reinforce- 
ment. 

These results lead to two conclusions: 
1) problem eaters are actually encouraged 
(shaped) by their social environment to 
refuse food; and 2) food is a sufficient 
reinforcer to control normal eating be- 
havior of schizophrenic patients. 
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Experiment II: Control 
of the Motor Behavior 
of Schizophrenic Patients by Food 


SuB JECTS 


After we had proved that patients will 
eat, we were now in a position to use food 
as a reinforcer in the development of 
motor responses. 

In order to increase the generality of 
our findings about the control of normal 
eating by food, 6 patients regarded as 
feeding problems were added to the pre- 
vious group. This addition made a total of 
38 patients, 13 of whom were selected be- 
cause of a history of refusing food. The 
median length of hospitalization for these 
6 patients was 16 years; their median age 
was 49 years. All 6 Ss were diagnosed as 
schizophrenic. One S received barbitu- 
rates, and the other 5 Ss received no 
medication, 


PROCEDURE 


The patients were required to drop a 
penny into the slot of a collection can to 
gain entrance to the dining room. In 
addition, access to the dining room was 
limited to 5 min from the time of meal 
call. The development of the coin as an 
SP for entering the dining room was 
begun by having a nurse distribute a 
penny to each of the patients congregated 
outside the dining room door at mealtime. 

In anticipation of difficulty, some shap- 
ing was used in this experiment. The first 
day of Experiment II, the 5-min access to 
the dining room was increased to 10 min 
per meal. However, after the second day, 
the time interval was again reduced to, 
and maintained at, 5-min. The nurses also 
used verbal shaping on the first day. The 


nurse told the patients, “Give this penny 
to the nurse when you go to eat.” When 
the dining room door was opened, another 
nurse stopped the patients at the door 
with, “Drop the penny in the collection 
can, please.” (The nurse pointed to the 
can placed outside the dining-room door.) 


RESULTS 


All patients learned the motor response 
required to obtain food reinforcement. 
Figure 2 shows that both the original pa- 
tients and the new ones added for this 
experiment showed a gradual development 
of the motor response. The segment of 
Experiment I immediately preceding Ex- 
periment II is included here by way of 
comparison. In the transition from Experi- 
ment I to Experiment II, the behavior of 
the original patients shows a temporary 
drop followed by a nearly complete re- 
covery. The motor response of the new 
patients reached a level comparable with 
that of the original patients. The differ- 
ence between them is less than 10%. 


DISCUSSION 


Irrespective of the patient’s history con- 
cerning eating, all patients learned the 
motor response. The acquisition of motor 
behavior was gradual for both the original 
and new patients. Initially, patients dis- 
played behaviors which suggested the 
difficulties in developing the penny as a 
discriminative stimulus. . . . 


Experiment III: Control 
of the Social Behavior 
of Schizophrenic Patients by Food 


SUBJECTS 


Once we had proved that schizo- 
phrenics can be conditioned to execute a 
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FIG. 2. When an additional requirement 
(motor response) is added to the require- 
ment of meeting a time limit to obtain 
food reinforcement, the percentage of food 
reinforcement obtained initially decreases, 
As the response develops, the percentage 
of food reinforcement obtained increases 
to approximately its previous level. From 
Ayllon and Haughton: Control of the be- 
havior of schizophrenic patients by food. 


nonsocial motor response, we became 
interested in exploring the extent to which 
we could control social responses. The 
purpose of this experiment was to deter- 
mine whether schizophrenics could be 
conditioned to cooperate with one an- 
other when the reinforcer is food. 

Two patients who had been in Experi- 
ments I and II were excluded from Ex- 
periment III. The first patient was ex- 
cluded because of a broken bone which 
required that she leave the ward; the 
other patient was transferred to another 
ward for routine tuberculosis check-up. 
Seven more patients with a history for 
being helped to eat were added for this 
experiment. This addition made a total of 
43 patients, 20 of whom were selected be- 
cause of a history of refusing food. 
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For the 5 years preceding admission to 
the experimental ward, all seven addi- 
tional patients were assisted regularly to 
eat their meals. Five of these patients had 
been given a food tray on the ward at 
mealtime. The food tray was placed on a 
table in front of the patient while a nurse 
sat with her to supervise her eating. Be- 
cause these patients had eaten under these 
circumstances, the nurses had not re- 
garded them as eating problems. The 
other two patients had been taken by the 
hand to the dining room to eat, and were 
intermittently spoonfed until they started 
to eat by themselves. 

The median length of hospitalization 
for the seven additional patients was 21 
years; their median age was 55 years. Five 
patients were diagnosed as schizophrenic, 
and two were diagnosed as mental defec- 
tive. Only two of these patients received 
medication: one received a phenothiazine 
derivative; and the other, barbiturates. 


PROCEDURE 


In Experiment II, all patients learned 
to execute the motor response that ad- 
mitted them into the dining room, e.g., 
obtaining the penny from the nurse and 
dropping it into the slot. After the penny 
was established as the SP for admission to 
the dining room, the next step was to 
make receipt of the penny dependent 
upon a cooperative response between two 
patients. 

For the present experiment, a device 
was designed which functioned upon the 
co-ordinated effort of two people; thus, 
the term “social response.” The device 
consisted of a table with one doorbell 
button at each end and a red light and 
buzzer in the middle. When the two 
buttons were pressed simultaneously, the 
light-buzzer came on. When only one was 
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pressed, the light-buzzer remained off. 
Since the buttons were 7% ft apart, one 
person could not press both of them at 
the same time. 

To allow sufficient time for the proper 
execution of the social response, the de- 
vice was available for the 5 min immedi- 
ately preceding the meal call, and also 
during the 5-min duration of access to the 
dining room. Verbal shaping was used the 
first week to facilitate learning the re- 
sponse. The instructions used to shape the 
patients were minimal; e.g, “Push the 
button and see what happens,” or “It 
takes two people to make the buzzer go.” 
When two patients pressed the buttons, 
the light-buzzer came on and the nurse 
handed a penny to each “partner.” 

This social response enabled the pa- 
tients to obtain the coin, but did not 
allow them free access to the dining room. 
Admission to the dining room required 
that the patient also insert the penny into 
the slot. Hence, the social response was 
required in addition to the motor re- 
sponse. 


REsutts 


The original patients, as well as the new 
ones added for this experiment, learned 
the social response necessary to obtain the 
coin; when they inserted the coin into the 
can, they had access to food reinforce- 
ment. 

Figure 3 shows that after the 1-week 
period of response shaping, both groups 
showed a gradual development of the so- 
cial response. Again, in the transition 
from one behavioral requirement to an- 
other, an initial temporary drop in the 
behavior was observed. Only one patient 
failed to develop the social response. This 
patient continued paying for meals by 
finding pennies, and even dimes, which 


she exchanged for pennies. Since the S? 
for entering the dining room was paying 
a penny, the nurse admitted her to eat, 


DISCUSSION 


This experiment clearly demonstrates 
the feasibility of exacting co-ordinated so- 
cial behavior from chronic schizophrenic 
patients in a hospital. . . . 

Verbal shaping was used only during 
the first week, but many patients neither 
acknowledged the nurse’s presence nor fol- 
lowed the minimal instructions. Because 
patients were not allowed to enter the 
dining room without first inserting a 
penny, most went immediately to the 
table where patients were pressing the 
buttons. Some patients tried pressing the 
button in the absence of a “partner.” 
Since nothing happened, a few banged the 
table, others walked away, and still others 
remained pressing the button until some- 
one managed to press the opposite button. 
In a short time, there were two lines of 
patients, one behind each button. 

The social responses necessary to gain 
access to meals produced other related re- 
sponses. These were largely verbal re- 
sponses directed to patients or to the 
nurses. Verbal behavior among patients 
centered about giving or receiving mutual 
help and information regarding the execu- 
tion of the social response. . . . 

The results of this experiment were 
very surprising to the staff. Because virtu- 
ally all of the patients were regarded as 
chronic, and “out of reality contact,” it 
seemed useless to expect them to be aware 
of each other. Because many patients ex- 
hibited hallucinations, e.g., gesticulating 
and talking incessantly in the absence of a 
visible audience, it seemed unreasonable 
to the staff to expect these patients to 
interrupt their psychotic symptoms in 
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time to engage in the social response de- 
manded in this experiment. Finally, the 
experiment was regarded as so stressful for 
the patients that a “wave” of eating prob- 
lems, particularly among those with a long 
history of such behavior, was anticipated. 
None of these apprehensions was sup- 
ported by our results. By the deliberate, 
controlled scheduling of consequences, 
the patients learned the appropriate re- 
sponses. . . . 
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46. 
Application of Operant Conditioning 
to Reinstate Verbal Behavior in Psychotics** 


Wayne Isaacs, James Thomas, 
and Israel Goldiamond 


In operant conditioning, behavior is 
controlled by explicitly arranging the con- 
sequences of the response, the explicit 
consequence being termed reinforcement. 
For example, a lever-press by a rat acti- 
vates a mechanism which releases food. If 
the rat has been deprived of food, lever- 
pressing responses will increase in fre- 
quency. If this relationship between food 
and response holds only when a light is 
on, the organism may discriminate be- 
tween light on and light off, that is, there 
will be no lever-pressing responses when 
the light is turned off, but turning it on 
will occasion such responses. From this 


*From W. Isaacs, J. Thomas, and I. 
Goldiamond, Application of operant con- 
ditioning to reinstate verbal behavior in 
psychotics, J. speech hearing Disorders, 
25, 8-12 (1960). Reprinted by permission 
of the authors and the Journal of Speech 
and Hearing Disorders. 

1 Wayne Isaacs (M.S., Southern Illinois 
University, 1951) is Assistant Clinical 
Director of Anna State Hospital, Anna, 
Illinois. James Thomas (M.A., University 
of Texas, 1953) was a clinical psychologist 
at the hospital during this experiment and 
is currently at Central State Hospital, 


simple case, extensions can be made to 
more complicated cases which may in- 
volve control of schedules of reinforce- 
ment. These procedures have recently 
been extended to the study of psycho- 
pharmacology (5), controlled production 
of stomach ulcers (4), obtaining psycho- 
physical curves from pigeons (3), condi- 
tioning cooperative behavior in children 
(2), programming machines which teach 
academic subjects (11), analyzing the 
effects of noise on human behavior (1), 
and decreasing stuttering (7), to mention 
a few examples. 

The following account is a preliminary 
report of the use of operant condition- 
ing to reinstate verbal behavior in two 
hospitalized mute psychotics. Patient A, 
classified as a catatonic schizophrenic, 40, 
became completely mute almost immedi- 
ately upon commitment 19 years ago. He 
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was recorded as withdrawn and exhibiting 
little psychomotor activity. Patient B, 
classified as schizophrenic, mixed type, 
with catatonic features predominating, 
was 43, and was commited after a 
psychotic break in 1942, when he was 
combative. He completely stopped verbal- 
izing 14 years ago. Each S was handled by 
a different E (experimenter). The E’s 
were ignorant of each other's activities 
until pressed to report their cases. This 
study covers the period prior to such 
report. 


Case Histories 
Patient A 


The S was brought to a group therapy 
session with other chronic schizophrenics 
(who were verbal), but he sat in the posi- 
tion in which he was placed and con- 
tinued the withdrawal behaviors which 
characterized him. He remained impassive 
and stared ahead even when cigarettes, 
which other members accepted, were of- 
fered to him and were waved before his 
face. At one session, when E removed 
cigarettes from his pocket, a package of 
chewing gum accidentally fell out. The S’s 
eyes moved toward the gum and then re- 
turned to their usual position. This re- 
sponse was chosen by E as one with 
which he would start to work, using the 
method of successive approximation (9). 
(This method finds use where E desires 
to produce responses which are not pres- 
ent in the current repertoire of the organ- 
ism and which are considerably removed 
from those which are available. The E 
then attempts to ‘shape’ the available be- 
haviors into the desired form, capitalizing 
upon both the variability and regularity of 
Successive behaviors. The shaping process 
involves the reinforcement of those parts 
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of a selected response which are succes- 
sively in the desired direction and the 
nonreinforcement of those which are not. 
For example, a pigeon may be initially re- 
inforced when it moves its head. When 
this movement occurs regularly, only an 
upward movement may be reinforced, 
with downward movement not reinforced. 
The pigeon may now stretch its neck, with 
this movement reinforced. Eventually the 
pigeon may be trained to peck at a disc 
which was initially high above its head 
and at which it would normally never 
peck. In the case of the psychotic under 
discussion, the succession was eye move- 
ment, which brought into play occasional 
facial movements, including those of the 
mouth, lip movements, vocalizations, 
word utterance, and finally, verbal be- 
havior.) 

The S met individually with E three 
times a week. Group sessions also con- 
tinued. The following sequence of pro- 
cedures was introduced in the private ses- 
sions. Although the weeks are numbered 
consecutively, they did not follow at regu- 
lar intervals since other duties kept E 
from seeing S every week. 

Weeks 1, 2. A stick of gum was held 
before S’s face, and E waited until S’s 
eyes moved toward it. When this response 
occurred, E as a consequence gave him 
the gum. By the end of the second week, 
response probability in the presence of 
the gum was increased to such an extent 
that S’s eyes moved toward the gum as 
soon as it was held up. 

Weeks 3, 4. The E now held the gum 
before S, waiting until he noticed move- 
ment in S’s lips before giving it to him. 
Toward the end of the first session of the 
third week, a lip movement spontaneously 
occurred, which E promptly reinforced. 
By the end of this week, both lip move- 
ment and eye movement occurred when 
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the gum was held up. The E then with- 
held giving S the gum until S spontane- 
ously made a vocalization, at which time 
E gave S the gum. By the end of this 
week, holding up the gum readily occa- 
sioned eye movement toward it, lip move- 
ment, and a vocalization resembling a 
croak. 

Weeks 5, 6. The E held up the gum, 
and said, ‘Say gum, gum,’ repeating these 
words each time S vocalized. Giving S the 
gum was made contingent upon vocaliza- 
tions increasingly approximating gum. At 
the sixth session (at the end of Week 6), 
when E said, ‘Say gum, gum,’ S suddenly 
said, ‘Gum, please.’ This response was 
accompanied by reinstatement of other 
responses of this class, that is, S answered 
questions regarding his name and age. 

Thereafter, he responded to questions by 
E both in individual sessions and in group 
sessions, but answered no one else. Re- 
sponses to the discriminative stimuli of 
the room generalized to E on the ward; he 
greeted E on two occasions in the group 
room. He read from signs in E’s office 
upon request by E, 

Since the response now seemed to be 
under the strong stimulus control of E, 
the person, attempt was made to gen- 
eralize the stimulus to other people. Ac- 
cordingly, a nurse was brought into the 
private room; S smiled at her. After a 
month, he began answering her questions. 
Later, when he brought his coat to a 
volunteer worker on the ward, she inter- 
preted the gesture as a desire to go out- 
doors and conducted him there. Upon 
informing E of the incident, she was 
instructed to obey S only as a consequence 
of explicit verbal requests by him. The S 
thereafter vocalized requests. These in- 
structions have now been given to other 
hospital personnel, and S regularly initi- 
ates verbal requests when nonverbal re- 


quests have no reinforcing consequences, 
Upon being taken to the commissary, he 
said, ‘Ping pong,’ to the volunteer worker 
and played a game with her. Other pa- 
tients, visitors, and members of hospital- 
society-at-large continue, however, to in- 
terpret nonverbal requests and to reinforce 
them by obeying S. 


Patient B 


This patient, with a combative history 
prior to mutism, habitually lay on a bench 
in the day room in the same position, 
rising only for meals and for bed. Weekly 
visits were begun by E and an attendant. 
During these visits, E urged S to attend 
group therapy sessions which were being 
held elsewhere in the hospital. The E of- 
fered S chewing gum. This was not ac- 
cepted during the first two visits, but was 
accepted on the third visit and thereafter. 
On the sixth visit, E made receipt of the 
gum contingent upon S’s going to the 
group room and so informed S. The S 
then altered his posture to look at E and 
accompanied him to the group room, 
where he seated himself in a chair and 
was given the gum. Thereafter, he came 
to this room when the attendants called 
for him. 

Group Sessions 1-4. Gum reinforce- 
ment was provided for coming to the first 
two weekly sessions, but starting with the 
third, it was made contingent upon S's 
participation in the announced group ac- 
tivity. The group (whose other members 
were verbal) was arranged in a semicircle. 
The E announced that each S would, 
when his turn came, give the name of an 
animal. The E immediately provided gum 
to each S who did so. The S did not re- 
spond and skipped his turn three times 
around. The same response occurred dur- 
ing the fourth session. 
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Group Session 5. The activity an- 
nounced was drawing a person; E pro- 
vided paper and colored chalk and visited 
each S in turn to examine the paper. The 
S had drawn a stick figure and was rein- 
forced with gum. Two of the other pa- 
tients, spontaneously and without prior 
prompting by E, asked to see the drawing 
and complimented S. Attendants reported 
that on the following day, S, when intro- 
duced to two ward visitors, smiled and 
said, ‘I’m glad to see you.’ The incident 
was followed by no particular explicit 
consequences. 

Group Session 6. The announced ac- 
tivity was to give the name of a city or 
town in Illinois. The S, in his turn, said, 
‘Chicago.’ He was reinforced by E, who 
gave him chewing gum, and again two 
members of the group congratulated him 
for responding. Thereafter, he responded 
whenever his turn came. 

After the tenth session in the group, 
gum reinforcement was discontinued. The 
S has continued to respond vocally in the 
situations in which he was reinforced by 
E but not in others. He never initiates 
conversations, but he will answer various 
direct questions in the group sessions. He 
will not, however, respond vocally to 
questions asked on the ward, even when 
put by E. 


DISCUSSION 


Both S’s came from special therapy 
wards of patients selected because of de- 
pressed verbal behavior and long stay in 
the hospital; tranquilizing drugs were not 
used. The extent to which reinstatement 
of verbal behavior was related to the spe- 
cial treatment offered the patients in the 
Special wards set up for them cannot 
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readily be assayed. Among the special 
treatments accorded them were group 
therapy sessions. Nevertheless, the simi- 
larities between the pattern of reacquisi- 
tion of verbal behavior by the patients and 
the patterns of learning encountered in 
laboratory studies suggest that the con- 
ditioning procedures themselves were in- 
volved in the reinstatement of verbal 
behavior. 

In the case of Patient A, the speaking 
response itself was gradually shaped. The 
anatomical relation between the muscles 
of chewing and speaking probably had 
some part in E’s effectiveness. When a 
word was finally produced, the response 
was reinstated along with other response 
members of its class, which had not been 
reinforced. The economy of this process is 
apparent, since it eliminates the necessity 
of getting S to produce every desired re- 
sponse in order to increase his repertoire. 
In this case, E concentrated on one verbal 
response, and in reinstating it, reinstated 
verbal responses in general. On the stimu- 
lus side, when the response came under 
the stimulus control of E, the stimulus 
could be generalized to other members of 
E’s class of discriminative stimuli, namely, 
people, This may have relevance for the 
clinical inference of the importance for 
future interpersonal relations of prior 
identification with some person. In the 
case of Patient B, the stimulus control in- 
volved a given setting, the rooms where 
he had been reinforced. The discrimina- 
tion of E in one case, and not in the 
other, may be explained in terms of the 
establishment of operant discrimination, 
which also involves extinction (9). Oper- 
ant discrimination is established when a 
response in the presence of SP, a discrim- 
inative stimulus, is reinforced, and a re- 
sponse in the presence of S4, a stimulus 
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other than SP, is not. After some time, the 
response will occur when SP is presented, 
but not when S4 is presented; the re- 
sponse discriminates SP from S4, it having 
been extinguished when S4 was presented. 
In the case of Patient A, E was with S on 
the ward, in the group room, and pri- 
vately. Reinforcement occurred in all oc- 
casions. But S was on the ward (and 
other rooms) without E, and therefore 
without reinforcement for those responses 
which were occasioned by the ward and 
which only E reinforced. Hence, these 
responses would extinguish in the ward 
alone, but would continue in the presence 
of E, defining discrimination of E from 
other stimuli. In the case of Patient B, 
this process may have been delayed by the 
fact that E and the other patients rein- 
forced only in a specific room. It will be 
recalled that attendants rather than E 
brought S to the group room. 
Interestingly, in the group sessions, 
when Patient B emitted the responses 
which E reinforced, other psychotic pa- 
tients also reinforced Patient B. They 
were thereby responding, on the occasion 
of S’s responses (discriminative stimuli for 
them), in the same way that E did. The 
term identification, used as a label here, 
shares some behavioral referents with the 
term as used in the preceding paragraph 
and might be explained behaviorally in 
terms of the generalized reinforcer (10). 
These behaviors by the patients are simi- 
lar to behaviors reported in client-centered 
group sessions, where clients increase in 
reflective behaviors as counseling pro- 
gresses, and in psychoanalytic group ses- 
sions, where patients increasingly make 
analytic interpretations of each other. 
Here, the patients are also behaving like 
the therapist. While this parallel lends 
itself to the facetious thought that oper- 
ant group sessions may produce operant 


conditioners, it does suggest that psy- 
chotics are behaving, with regard to re- 
sponses by the major source of reinforce- 
ment in the group, according to the same 
laws which govern such group behaviors 
of nonhospitalized S’s. 

The various diagnostic labels applied to 
psychotics are based to a considerable ex- 
tent upon differences between responses 
considered abnormal, for example, hallu- 
cinations, delusions of persecution, and 
the like. The therapeutic process is ac- 
cordingly at times seen in terms of elimi- 
nating the abnormal behaviors or states. 
Experimental laboratory work indicates 
that it is often extremely difficult to 
eliminate behavior; extinction is extremely 
difficult where the schedule of reinforce- 
ment has been a variable interval sched- 
ule (6), that is, reinforcement has been 
irregular, as it is in most of our behaviors. 
Such behaviors persist for considerable 
periods without reinforcement. Experi- 
mental laboratory work has provided us 
quite readily with procedures to increase 
responses. In the case of psychotics, this 
would suggest focusing attention on what- 
ever normal behaviors S has; an appropri- 
ate operant, no matter how small or insig- 
nificant, even if it is confined to an eye 
movement, may possibly be raised to 
greater probability, and shaped to normal 
behavior (8). Stated otherwise, abnormal 
behaviors and normal behaviors can be 
viewed as reciprocally related, and psy- 
chotics as exhibiting considerable abnor- 
mal behavior, or little normal behavior. 
Normal behavior probability can be 
increased by decreasing probability of ab- 
normal behaviors, or abnormal behaviors 
can be decreased by the controlled in- 
crease of normal behaviors. This prelimi- 
nary report suggests that a plan of attack 
based upon the latter approach may be 
worth further investigation. 
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SUMMARY 


Verbal behavior was reinstated in two 
psychotics, classified as schizophrenics, 
who had been mute for 19 and 14 
years. The procedures utilized involved 
application of operant conditioning. The 
relationship of such procedures, based on 
controlled laboratory investigations with 
men and animals, to procedures based on 
clinical practice with human patients was 
discussed and was considered as directing 
our attention to shaping and increasing 
the probability of what normal behaviors 
the psychotic possesses. 
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47. 
The Elimination of Tantrum Behavior 
by Extinction Procedures* 


Carl D. Williams 


This paper reports the successful treat- 
ment of tyrant-like tantrum behavior in a 
male child by the removal of reinforce- 
ment. The subject (S) was approximately 
21 months old. He had been seriously ill 
much of the first 18 months of his life. 
His health then improved considerably, 
and he gained weight and vigor. 

S now demanded the special care and 
attention that had been given him over 
the many critical months. He enforced 
some of his wishes, especially at bedtime, 
by unleashing tantrum behavior to con- 
trol the actions of his parents. 

The parents and an aunt took turns in 
putting him to bed both at night and for 
S’s afternoon nap. If the parent left the 
bedroom after putting S in his bed, S 
would scream and fuss until the parent 
returned to the room. As a result, the 
parent was unable to leave the bedroom 
until after S went to sleep. If the parent 


* From C. D, Williams, The elimination 
of tantrum behavior by extinction pro- 
cedures, J. abnorm. soc. Psychol., 59, 269 
(1959). Reprinted by permission of the 
author and the American Psychological 
Association. 


began to read while in the bedroom, S 
would cry until the reading material was 
put down. The parents felt that S enjoyed 
his control over them and that he fought 
off going to sleep as long as he could. In 
any event, a parent was spending from 


one-half to two hours each bedtime just 
waiting in the bedroom until § went to 
sleep. 

Following medical reassurance regard- 


ing S’s physical condition, it was decided 
to remove the reinforcement of this ty- 
rant-like tantrum behavior. Consistent 
with the learning principle that, in gen- 
eral, behavior that is not reinforced will 
be extinguished, a parent or the aunt put 
S to bed in a leisurely and relaxed fashion. 
After bedtime pleasantries, the parent left 
the bedroom and closed the door. S 
screamed and raged, but the parent did 
not re-enter the room. The duration of 
screaming and crying was obtained from 
the time the door was closed. 

The results are shown in Fig. 1. It can 
be seen that S continued screaming for 
45 min. the first time he was put to bed in 
the first extinction series. S did not cry at 
all the second time he was put to bed. 
This is perhaps attributable to his fatigue 
from the crying of Occasion 1. By the 
tenth occasion, S no longer whimpered, 
fussed, or cried when the parent left the 
room. Rather, he smiled as they left. The 
parents felt that he made happy sounds 
until he dropped off to sleep. 
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About a week later, S screamed and 
fussed after the aunt put him to bed, 
probably reflecting spontaneous recovery 
of the tantrum behavior. The aunt then 
reinforced the tantrum behavior by re- 
turning to S’s bedroom and remaining 
there until he went to sleep. It was then 
necessary to extinguish this behavior a 
second time. 

Figure 1 shows that the second extinc- 
tion curve is similar to the first. Both 
curves are generally similar to extinction 
curves obtained with subhuman subjects. 
The second extinction series reached 
zero by the ninth occasion. No further 
tantrums at bedtime were reported during 
the next two years. 

It should be emphasized that the treat- 
ment in this case did not involve aversive 
punishment. All that was done was to 
remove the reinforcement. Extinction of 
the tyrant-like tantrum behavior then oc- 
curre 

No unfortunate side- or aftereffects of 
this treatment were observed. At three 
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and three-quarters years of age, S appeared 
to be a friendly, expressive, outgoing 
child. 


——— FIRST EXTINCTION 


a 
& 


SECOND EXTINCTION 


DURATION OF CRYING IN MINUTES 


TIMES CHILD PUT TO BED 


FIG. 1. Length of crying in two extinction 
series as a function of successive occasions 
of being put to bed. From Williams: The 
elimination of tantrum behavior by ex- 
tinction procedures. 


48. 
Psychotherapy as a Learning Process* 


Albert Bandura 


* From A. Bandura, Psychotherapy as a 
learning process, Psychol, Bull., 58, 143- 
159 (1961). Reprinted by permission of 
the author and the American Psychological 
Association. 


While it is customary to conceptualize 
psychotherapy as a learning process, few 
therapists accept the full implications of 
this position. Indeed, this is best illus- 
trated by the writings of the learning 
theorists themselves. Most of our current 
methods of psychotherapy represent an 
accumulation of more or less uncontrolled 
clinical experiences and, in many in- 
stances, those who have written about 
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psychotherapy in terms of learning theory 
have merely substituted a new language; 
the practice remains essentially un- 
changed (Dollard, Auld, & White, 1954; 
Dollard & Miller, 1950; Shoben, 1949). 

If one seriously subscribes to the view 
that psychotherapy is a learning process, 
the methods of treatment should be de- 
rived from our knowledge of learning and 
motivation. Such an orientation is likely 
to yield new techniques of treatment 
which, in many respects, may differ mark- 
edly from the procedures currently in use. 

Psychotherapy rests on a very simple 
but fundamental assumption, i.e., human 
behavior is modifiable through psycho- 
logical procedures. When skeptics raise 
the question, “Does psychotherapy 
work?” they may be responding in part to 
the mysticism that has come to surround 
the term. Perhaps the more meaningful 
question, and one which avoids the sur- 
plus meanings associated with the term 
“psychotherapy,” is as follows: Can hu- 
man behavior be modified through psy- 
chological means and if so, what are the 
learning mechanisms that mediate behav- 
ior change? 

In the sections that follow, some of 
these learning mechanisms will be dis- 
cussed, and studies in which systematic 
attempts have been made to apply these 
principles of learning to the area of psy- 
chotherapy will be reviewed. Since learn- 
ing theory itself is still somewhat incom- 
plete, the list of psychological processes 
by which changes in behavior can occur 
should not be regarded as exhaustive, nor 
are they necessarily without overlap. 


Counterconditioning 


Of the various treatment methods de- 
rived from learning theory, those based on 
the principle of counterconditioning have 


been elaborated in greatest detail. Wolpe 
(1954, 1958, 1959) gives a thorough ac- 
count of this method, and additional ex- 
amples of cases treated in this manner are 
provided by Jones (1956), Lazarus and 
Rachman (1957), Meyer (1957), and 
Rachman (1959), Briefly, the principle 
involved is as follows: if strong responses 
which are incompatible with anxiety reac- 
tions can be made to occur in the presence 
of anxiety evoking cues, the incompatible 
responses will become attached to thesé 
cues and thereby weaken or eliminate the 
anxiety responses. 

The first systematic psychotherapeuti¢ 
application of this method was reported 
by Jones (1924b) in the treatment of 
Peter, a boy who showed severe phobic 
reactions to animals, fur objects, cotton, 
hair, and mechanical toys. Countercondi- 
tioning was achieved by feeding the child 
in the presence of initially small but 
gradually increasing anxiety-arousing stim- 
uli. A rabbit in a cage was placed in the 
room at some distance so as not to disturb 
the boy’s eating. Each day the rabbit was 
brought nearer to the table and eventually 
removed from the cage. During the final 
stage of treatment, the rabbit was placed 
on the feeding table and even in Peter’s 
lap. Tests of generalization revealed that 
the fear responses had been effectively 
eliminated, not only toward the rabbit, 
but toward the previously feared furry ob- 
jects as well. 

In this connection, it would be interest- 
ing to speculate on the diagnosis and 
treatment Peter would have received had 
he been seen by Melanie Klein (1949) 
rather than by Mary Cover Jones! 

It is interesting to note that while both 
Shoben (1949) and Wolpe (1958) pro- 
pose a therapy based on the principle of 
counterconditioning, their treatment 
methods are radically different. According 
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to Shoben, the patient discusses and 
thinks about stimulus situations that are 
anxiety provoking in the context of an 
interpersonal situation which simultane- 
ously elicits positive affective responses 
from the patient. The therapeutic process 
consists in connecting the anxiety provok- 
ing stimuli, which are symbolically repro- 
duced, with the comfort reaction made 
to the therapeutic relationship. 

Shoben’s paper represents primarily a 
counterconditioning interpretation of the 
behavior changes brought about through 
conventional forms of psychotherapy 
since, apart from highlighting the role of 
positive emotional reactions in the treat- 
ment process, no new techniques delib- 
erately designed to facilitate relearning 
through counterconditioning are pro- 
posed. 

This is not the case with Wolpe, who 
has made a radical departure from tradi- 
tion. In his treatment, which he calls 
reciprocal inhibition, Wolpe makes sys- 
tematic use of three types of responses 
which are antagonistic to, and therefore 
inhibitory of, anxiety. These are: assertive 
or approach responses, sexual responses, 
and relaxation responses. 

On the basis of historical information, 
interview data, and psychological test re- 
sponses, the therapist constructs an anxi- 
ety hierarchy, a ranked list of stimuli to 
which the patient reacts with anxiety. In 
the case of desensitization based on re- 
laxation, the patient is hypnotized and 
given relaxation suggestions. He is then 
asked to imagine a scene representing the 
weakest item on the anxiety hierarchy and, 
if the relaxation is unimpaired, this is 
followed by having the patient imagine 
the next item on the list, and so on. 
Thus, the anxiety cues are gradually in- 
creased from session to session until the 
last phobic stimulus can be presented 
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without impairing the relaxed state. 
Through this procedure, relaxation re- 
sponses eventually come to be attached 
to the anxiety evoking stimuli. 

Wolpe reports remarkable therapeutic 
success with a wide range of neurotic reac- 
tions treated on this counterconditioning 
principle. He also contends that the fav- 
orable outcomes achieved by the more 
conventional psychotherapeutic methods 
may result from the reciprocal inhibition 
of anxiety by strong positive responses 
evoked in the patient-therapist relation- 
ship. 

Although the  counterconditioning 
method has been employed most exten- 
sively in eliminating anxiety-motivated 
avoidance reactions and inhibitions, it has 
been used with some success in reducing 
maladaptive approach responses as well. 
In the latter case, the goal object is re- 
peatedly associated with some form of 
aversive stimulus. 

Raymond (1956), for example, used 
nausea as the aversion experience in the 
treatment of a patient who presented a 
fetish for handbags and perambulators 
which brought him into frequent contact 
with the law in that he repeatedly smeared 
mucus on ladies’ handbags and destroyed 
perambulators by running into them with 
his motorcycle. Though the patient had 
undergone psychoanalytic treatment, and 
was fully aware of the origin and the sex- 
ual significance of his behavior, neverthe- 
less, the fetish persisted. 

The treatment consisted of showing the 
patient a collection of handbags, peram- 
bulators, and colored illustrations just be- 
fore the onset of nausea produced by 
injections of apomorphine. The condi- 
tioning was repeated every 2 hours day and 
night for 1 week plus additional sessions 
8 days and 6 months later. 

Raymond reports that, not only was 
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the fetish successfully eliminated, but also 
the patient showed a vast improvement in 
his social (and legal) relationships, was 
promoted to a more responsible position 
in his work, and no longer required the 
fetish fantasies to enable him to have 
sexual intercourse. 

Nauseant drugs, especially emetine, 
have also been utilized as the uncondi- 
tioned stimulus in the aversion treatment 
of alcoholism (Thirmann, 1949; Thomp- 
son & Bielinski, 1953; Voegtlen, 1940; 
Wallace, 1949). Usually 8 to 10 treat- 
ments in which the sight, smell, and taste 
of alcohol is associated with the onset of 
nausea is sufficient to produce abstinence. 
Of 1,000 or more cases on whom adequate 
follow-up data are reported, approximately 
60% of the patients have been totally 
abstinent following the treatment. Voegt- 
len (1940) suggests that a few preventive 
treatments given at an interval of about 6 
months may further improve the results 
yielded by this method. 

Despite these encouraging findings, 
most psychotherapists are unlikely to be 
impressed since, in their opinion, the 
underlying causes for the alcoholism have 
in no way been modified by the condition- 
ing procedure and, if anything, the mere 
removal of the alcoholism would tend to 
produce symptom substitution or other 
adverse effects. A full discussion of this 
issue will be presented later. In this par- 
ticular context, however, several aspects of 
the Thompson and Bielinski (1953) data 
are worth noting. Among the alcoholic 
patients whom they treated, six “suffered 
from mental disorders not due to alcohol 
or associated deficiency states.” It was 
planned, by the authors, to follow up the 
aversion treatment with psychotherapy for 
the underlying psychosis. This, however, 
proved unnecessary since all but one of 
the patients, a case of chronic mental de- 


terioration, showed marked improvement 
and were in a state of remission. 

Max (1935) employed a strong electric 
shock as the aversive stimulus in treating 
a patient who tended to display homo- 
sexual behavior following exposure to a 
fetishistic stimulus. Both the fetish and 
the homosexual behavior were removed 
through a series of avoidance condition- 
ing sessions in which the patient was 
administered shock in the presence of the 
fetishistic object. 

Wolpe (1958) has also reported favor- 
able results with a similar procedure in 
the treatment of obsessions. 

A further variation of the coun 
ditioning procedure has been d 


by Mowrer and Mowrer (1938) for use 
with enuretic patients. The device con- 
sists of a wired bed pad which sets off a 
loud buzzer and awakens the child as soon 
as micturition begins. Bladder tension 


thus becomes a cue for waking up which, 
in turn, is followed by sphincter contrac- 
tion. Once bladder pressure becomes 
stimulus for the more remote sphincter 
control response, the child is able to re- 
main dry for relatively long periods of 
time without wakening. 

Mowrer and Mowrer (1938) report 
complete success with 30 children treated 
by this method; similarly, Davidson and 
Douglass (1950) achieved highly success- 
ful results with 20 chronic enuretic chil- 
dren (15 cured, 5 markedly improved); of 
5 cases treated by Morgan and Witmer 
(1939), 4 of the children not only gained 
full sphincter control, but also made a 
significant improvement in their social be- 
havior. The one child with whom the 
conditioning approach had failed was 
later found to have bladder difficulties 
which required medical attention. 

Some additional evidence for the ef 
ficacy of this method is provided by 
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Martin and Kubly (1955) who obtained 
follow-up information from 118 of 220 
parents who had treated their children at 
home with this type of conditioning ap- 


paratus. In 74% of the cases, according 
to parents’ replies, the treatment was 
successful. 
Extinction 

“When a learned response is repeated 
without reinforcement the strength of the 


tendency to perform that response under- 
goes a progressive decrease” (Dollard & 
Miller, 1950). Extinction involves the de- 
velopment of inhibitory potential which 
is composed of two components. The 
evocation of any reaction generates reac- 
tive inhibition (I,) which presumably dis- 
sipates with time. When reactive inhibi- 
tion (fatigue, etc.) reaches a high point, 
the cessation of activity alleviates this 
negative motivational state and any stim- 
uli associated with the cessation of the 
tesponse become conditioned inhibitors 
(la). 

One factor that has been shown to in- 
fluence the rate of extinction of maladap- 
tive and anxiety-motivated behavior is the 
interval between extinction trials. In gen- 
eral, there tends to be little diminution in 
the strength of fear-motivated behavior 
when extinction trials are widely distrib- 
uted, whereas under massed trials, reactive 
inhibition builds up rapidly and conse- 
quently extinction is accelerated (Calvin, 
Clifford, Clifford, Bolden, & Harvey, 1956; 
Edmonson & Amsel, 1954). 

An illustration of the application of this 
principle is provided by Yates (1958) in 
the treatment of tics. Yates demonstrated, 
in line with the findings from laboratory 
studies of extinction under massed and 
distributed practice, that massed sessions 
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in which the patient performed tics volun- 
tarily followed by prolonged rest to allow 
for the dissipation of reactive inhibition 
was the most effective procedure for ex- 
tinguishing the tics. 

It should be noted that the extinction 
procedure employed by Yates is very simi- 
lar to Dunlap’s method of negative prac- 
tice, in which the subject reproduces the 
negative behaviors voluntarily without re- 
inforcement (Dunlap, 1932; Lehner, 
1954). This method has been applied 
most frequently, with varying degrees of 
success, to the treatment of speech dis- 
orders (Fishman, 1937; Meissner, 1946; 
Rutherford, 1940; Sheehan, 1951; Sheehan 
& Voas, 1957). If the effectiveness of this 
psychotherapeutic technique is due pri- 
marily to extinction, as suggested by Yates’ 
study, the usual practice of terminating a 
treatment session before the subject be- 
comes fatigued (Lehner, 1954), would 
have the effect of reducing the rate of ex- 
tinction, and may in part account for the 
divergent results yielded by this method. 

Additional examples of the therapeutic 
application of extinction procedures are 
provided by Jones (1955), and most re- 
cently by C. D. Williams (1959). 

Most of the conventional forms of 
psychotherapy rely heavily on extinction 
effects although the therapist may not 
label these as such. For example, many 
therapists consider permissiveness to be a 
necessary condition of therapeutic change 
(Alexander, 1956; Dollard & Miller, 1950; 
Rogers, 1951). It is expected that when a 
patient expresses thoughts or feelings that 
provoke anxiety or guilt and the therapist 
does not disapprove, criticize, or withdraw 
interest, the fear or guilt will be gradually 
weakened or extinguished. The extinction 
effects are believed to generalize to 
thoughts concerning related topics that 
were originally inhibited, and to verbal 
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and physical forms of behavior as well 
(Dollard & Miller, 1950). 

Some evidence for the relationship be- 
tween permissiveness and the extinction 
of anxiety is provided in two studies re- 
cently reported by Dittes (1957a, 1957b). 
In one study (1957b) involving an analy- 
sis of patient-therapist interaction se- 
quences, Dittes found that permissive re- 
sponses on the part of the therapist were 
followed by a corresponding decrease in 
the patient’s anxiety (as measured by the 
GSR) and the occurrence of avoidance 
behaviors. A sequential analysis of the 
therapeutic sessions (Dittes, 1957a), re- 
vealed that, at the onset of treatment, sex 
expressions were accompanied by strong 
anxiety reactions; under the cumulative 
effects of permissiveness, the anxiety grad- 
ually extinguished. 

In contrast to counterconditioning, ex- 
tinction is likely to be a less effective and 
a more time consuming method for elimi- 
nating maladaptive behavior (Jones, 
1924a; Dollard & Miller, 1950); in the 
case of conventional interview therapy, 
the relatively long intervals between inter- 
view sessions, and the ritualistic adherence 
to the 50-minute hour may further reduce 
the occurrence of extinction effects, . . . 


Methods of Reward 


Most theories of psychotherapy are 
based on the assumption that the patient 
has a repertoire of previously learned posi- 
tive habits available to him, but that these 
adaptive patterns are inhibited or blocked 
by competing responses motivated by 
anxiety or guilt. The goal of therapy, then, 
is to reduce the severity of the internal 
inhibitory controls, thus allowing the 
healthy patterns of behavior to emerge. 
Hence, the role of the therapist is to 
create permissive conditions under which 


the patient’s “normal growth potentiali- 
ties” are set free (Rogers, 1951). The fact 
that most of our theories of personality 
and therapeutic procedures have been de- 
veloped primarily through work with over- 
socialized, neurotic patients may account 
in part for the prevalence of this view. 
There is a large class of disorders (the 
undersocialized, antisocial personalities 
whose behavior reflects a failure of the 
socialization process) for whom this 
model of personality and accompanying 
techniques of treatment are quite inap- 
propriate (Bandura & Walters, 1959; 
Schmideberg, 1959). Such antisocial per- 
sonalities are likely to present -learning 
deficits, consequently the goal of therapy 
is the acquisition of secondary motives 
and the development of internal restraint 
habits. That antisocial patients prove un- 
responsive to psychotherapeutic methods 
developed for the treatment of oversocial- 
ized neurotics has been demonstrated in a 
number of studies comparing patients 
who remain in treatment with those who 
terminate treatment prematurely (Ruben- 
stein & Lorr, 1956). It is for this class of 
patients that the greatest departures from 
traditional treatment methods is needed. 
While counterconditioning, extinction, 
and discrimination learning may be effec- 
tive ways of removing neurotic inhibitions, 
these methods may be of relatively little 
value in developing new positive habits. 
Primary and secondary rewards in the 
form of the therapist’s interest and ap- 
proval may play an important, if not in- 
dispensable, role in the treatment process. 
Once the patient has learned to want the 
interest and approval of the therapist, 
these rewards may then be used to pro- 
mote the acquisition of new patterns of 
behavior. For certain classes of patients 
such as schizophrenics (Atkinson, 1957; 
Peters, 1953; Robinson, 1957) and delin- 
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quents (Cairns, 1959), who are either un- 
responsive to, or fearful of, social rewards, 
the therapist may have to rely initially on 
primary rewards in the treatment process. 

An ingenious study by Peters and Jen- 
kins (1954) illustrates the application of 
this principle in the treatment of schizo- 
phrenic patients. Chronic patients from 
closed wards were administered subshock 
injections of insulin designed to induce 
the hunger drive. The patients were then 
encouraged to solve a series of graded 
problem tasks with fudge as the reward. 
This program was followed 5 days a week 
for 3 months. 

Initially the task involved simple mazes 
and obstruction problems in which the 
patients obtained the food reward directly 
upon successful completion of the prob- 
lem. Tasks of gradually increasing diffi- 
culty were then administered involving 
multiple-choice learning and verbal-reason- 
ing problems in which the experimenter 
personally mediated the primary rewards. 
After several weeks of such problem solv- 
ing activities the insulin injections were 
discontinued and social rewards, which by 
this time had become more effective, were 
used in solving interpersonal problems 
that the patients were likely to encounter 
in their daily activities both inside and 
outside the hospital setting. 

Comparison of the treated group with 
control groups, designed to isolate the 
effects of insulin and special attention, 
revealed that the patients in the reward 
group improved significantly in their so- 
cial relationships in the hospital, whereas 
the patients in the control groups showed 
no such change. 

King and Armitage (1958) report a 
somewhat similar study in which severely 
withdrawn schizophrenic patients were 
treated with operant conditioning meth- 
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ods; candy and cigarettes served as the 
primary rewards for eliciting and main- 
taining increasingly complex forms of be- 
havior, i.e. psychomotor, verbal, and 
interpersonal responses. Unlike the Peters 
and Jenkins study, no attempt was made 
to manipulate the level of primary motiva- 
tion. 

An interesting feature of the experi- 
mental design was the inclusion of a 
group of patients who were treated with 
conventional interview therapy, as well as 
a recreational therapy and a no-therapy 
control group. It was found that the oper- 
ant group, in relation to similar patients 
in the three control groups, made sig- 
nificantly more clinical improvement. 

Skinner (1956b) and Lindsley (1956) 
working with adult psychotics, and Ferster 
(1959) working with autistic children, 
have been successful in developing sub- 
stantial amounts of reality-oriented be- 
havior in their patients through the use of 
reward. So far their work has been con- 
cerned primarily with the effect of sched- 
ules of reinforcement on the rate of evoca- 
tion of simple impersonal reactions. There 
is every indication, however, that by vary- 
ing the contingency of the reward (e.g. 
the patient must respond in certain speci- 
fied ways to the behavior of another indi- 
vidual in order to produce the reward) 
adaptive interpersonal behaviors can be 
developed as well (Azran & Lindsley, 
1956). 

The effectiveness of social reinforcers 
in modifying behavior has been demon- 
strated repeatedly in verbal conditioning 
experiments (Krasner, 1958; Salzinger, 
1959). Encouraged by these findings, sev- 
eral therapists have begun to experiment 
with operant conditioning as a method of 
treatment in its own right (Tilton, 1956; 
Ullman, Krasner, & Collins, in press; R.I. 
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Williams, 1959); the operant condition- 
ing studies cited earlier are also illustrative 
of this trend. 

So far the study of generalization and 
permanence of behavior changes brought 
about through operant conditioning meth- 
ods has received relatively little attention 
and the scanty data available are equivocal 
(Rogers, 1960; Sarason, 1957; Weide, 
1959). The lack of consistency in results 
is hardly surprising considering that the 
experimental manipulations in many of 
the conditioning studies are barely suffi- 
cient to demonstrate conditioning effects, 
let alone generalization of changes to new 
situations. On the other hand, investi- 
gators who have conducted more intensive 
reinforcement sessions, in an effort to test 
the efficacy of operant conditioning meth- 
ods as a therapeutic technique, have found 
significant changes in patients’ interper- 
sonal behavior in extra-experimental situa- 
tions (King & Armitage, 1958; Peters & 
Jenkins, 1954; Ullman et al., in press). 
These findings are particularly noteworthy 
since the response classes involved are 
similar to those psychotherapists are pri- 
marily concerned in modifying through 
interview forms of treatment. If the favor 
able results yielded by these studies are 
replicated in future investigations, it is 
likely that the next few years will witness 
an increasing reliance on conditioning 
forms of psychotherapy, particularly in the 
treatment of psychotic patients. 

At this point it might also be noted 
that, consistent with the results from 
verbal conditioning experiments, content 
analyses of psychotherapeutic interviews 
(Bandura, Lipsher, & Miller, 1960; Mur- 
ray, 1956) suggest that many of the 
changes observed in psychotherapy, at 
least insofar as the patients’ verbal be- 
havior is concerned, can be accounted for 
in terms of the therapists’ direct, although 


usually unwitting, reward and punishment 
of the patients’ expressions. 


Punishment 


While positive habits can be readily 
developed through reward, the elimina- 
tion of socially disapproved habits, which 
becomes very much an issue in the treat- 
ment of antisocial personalities, poses a 
far more complex problem. 

The elimination of socially disapproved 


behaviors can be accomplished in several 
ways. They may be consistently unre- 
warded and thus extinguished. However, 


antisocial behavior, particularly of an ex- 
treme form, cannot simply be ignored in 
the hope that it will gradually exting guik 
Furthermore, since the successful execu- 
tion of antisocial acts may bring substan- 
tial material rewards as well as the ap- 
proval and admiration of associates, it is 
extremely unlikely that such behavior 
would ever extinguish. 

Although punishment may lead to the 
rapid disappearance of socially disap- 
proved behavior, its effects are far more 
complex (Estes, 1944; Solomon, Kamin, 
& Wynne, 1953). If a person is punished 
for some socially disapproved habit, the 
impulse to perform the act becomes, 
through its association with punishment, 
a stimulus for anxiety. This anxiety then 
motivates competing responses which, if 
sufficiently strong, prevent the occurrence 
of, or inhibit, the disapproved behavior. 
Inhibited responses may not, however, 
thereby lose their strength, and may re- 
appear in situations where the threat of 
punishment is weaker. Punishment may, 
in fact, prevent the extinction of a habit; 
if a habit is completely inhibited, it can- 
not occur and therefore cannot go un- 
rewarded. 

Several other factors point to the futility 
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of punishment as a means of correcting 
many antisocial patterns. The threat of 
punishment is very likely to elicit con- 
formity; indeed, the patient may oblig- 
ingly do whatever he is told to do in order 
to avoid immediate difficulties. This does 
not mean, however, that he has acquired 
a set of sanctions that will be of service to 
him once he is outside the treatment situa- 
tion. In fact, rather than leading to the 
development of internal controls, such 
hods are likely only to increase the 
it’s reliance on external restraints. 
over, under these conditions, the 
ity of patients will develop the atti- 
that they will do only what they are 
told to do—and then often only half- 
heartedly—and that they will do as they 
please once they are free from the thera- 
pist’s supervision (Bandura & Walters, 
1959) 

In addition, punishment may serve 
only to intensify hostility and other nega- 
tive motivations and thus may further 
instigate the antisocial person to display 
the very behaviors that the punishment 
was intended to bring under control. 

Mild aversive stimuli have been utilized, 
of course, in the treatment of voluntary 
patients who express a desire to rid them- 
selves of specific debilitating conditions. 

Liversedge and Sylvester (1955), for 
example, successfully treated seven cases 
of writer’s cramp by means of a retraining 
procedure involving electric shock. In 
order to remove tremors, one component 
of the motor disorder, the patients were 
required to insert a stylus into a series of 
progressively smaller holes; each time the 
stylus made contact with the side of the 
hole the patients received a mild shock. 
The removal of the spasm component of 
the disorder was obtained in two ways. 
First, the patients traced various line pat- 
terns (similar to the movements required 
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in writing) on a metal plate with a stylus, 
and any deviation from the path produced 
a shock. Following training on the appa- 
ratus, the subjects then wrote with an 
electrified pen which delivered a shock 
whenever excessive thumb pressure was 
applied. 

Liversedge and Sylvester report that fol- 
lowing the retraining the patients were 
able to resume work; a follow-up several 
months later indicated that the improve- 
ment was being maintained. 

The aversive forms of therapy, described 
earlier in the section on countercondition- 
ing procedures, also make use of mild pun- 
ishment. 


Social Imitation 


Although a certain amount of learning 
takes place through direct training and 
reward, a good deal of a person’s behavior 
repertoire may be acquired through imita- 
tion of what he observes in others. If this 
is the case, social imitation may serve as 
an effective vehicle for the transmission of 
prosocial behavior patterns in the treat- 
ment of antisocial patients. 

Merely providing a model for imitation 
is not, however, sufficient. Even though 
the therapist exhibits the kinds of be- 
haviors that he wants the patient to learn, 
this is likely to have little influence on 
him if he rejects the therapist as a model. 
Affectional nurturance is believed to be 
an important precondition for imitative 
learning to occur, in that affectional re- 
wards increase the secondary reinforcing 
properties of the model, and thus predis- 
pose the imitator to pattern his behavior 
after the rewarding person (Mowrer, 
1950; Sears, 1957; Whiting, 1954). Some 
positive evidence for the influence of so- 
cial rewards on imitation is provided by 
Bandura and Huston (in press) in a re- 
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cent study of identification as a process 
of incidental imitation. . . . 

A more crucial test of the transmission 
of behavior patterns through the process 
of social imitation involves the delayed 
generalization of imitative responses to 
new situations in which the model is 
absent. A study of this type just com- 
pleted, provides strong evidence that ob- 
servation of the cues produced by the be- 
havior of others is an effective means of 
eliciting responses for which the original 
probability is very low (Bandura, Ross, & 
Ross, in press). 

Empirical studies of the correlates of 
strong and weak identification with par- 
ents, lend additional support to the theory 
that rewards promote imitative learning. 
Boys whose fathers are highly rewarding 
and affectionate have been found to adopt 
the father-role in doll-play activities 
(Sears, 1953), to show father-son similarity 
in response to items on a personality 
questionnaire (Payne & Mussen, 1956), 
and to display masculine behaviors (Mus- 
sen & Distler, 1956, 1960) to a greater 
extent than boys whose fathers are rela- 
tively cold and nonrewarding. 

The treatment of older unsocialized 
delinquents is a difficult task, since they 
are relatively self-sufficient and do not 
readily seek involvement with a therapist. 
In many cases, socialization can be accom- 
plished only through residential care and 
treatment. In the treatment home, thé 
therapist can personally administer many 
of the primary rewards and mediate be- 
tween the boys’ needs and gratifications. 
Through the repeated association with re- 
warding experiences for the boy, many of 
the therapist’s attitudes and actions will 
acquire secondary reward value, and thus 
the patient will be motivated to reproduce 
these attitudes and actions in himself. 
Once these attitudes and values have been 


thus accepted, the boy’s inhibition of anti- 
social tendencies will function independ- 
ently of the therapist. 

While treatment through social imita- 
tion has been suggested as a method for 
modifying antisocial patterns, it can be an 
effective procedure for the treatment of 
other forms of disorders as well. Jones 
(1924a), for example, found that the so- 
cial example of children reacting normally 
to stimuli feared by another child was 
effective, in some instances, in eliminating 
such phobic reactions. In fact, next to 
counterconditioning, the method of so- 
cial imitation proved to be most effective 
in eliminating inappropriate fears. 

There is some suggestive evidence that 
by providing high prestige models and 
thus increasing the reinforcement value of 
the imitatee’s behavior, the effectiveness 
of this method in promoting favorable 
adjustive patterns of behavior may be fur- 
ther increased (Jones, 1924a; Mausner, 
1953, 1954; Miller & Dollard, 1941). 

During the course of conventional 
psychotherapy, the patient is exposed to 
many incidental cues involving the thera- 
pist’s values, attitudes, and patterns of be- 
havior. They are incidental only because 
they are usually considered secondary or 
irrelevant to the task of resolving the pa- 
tient’s problems. Nevertheless, some of 
the changes observed in the patient’s be- 
havior may result, not so much from the 
intentional interaction between the pa- 
tient and the therapist, but rather from 
active learning by the patient of the thera- 
pist’s attitudes and values which the 
therapist never directly attempted to 
transmit. This is partially corroborated 
by Rosenthal (1955) who found that, in 
spite of the usual precautions taken by 
therapists to avoid imposing their values 
on their clients, the patients who were 
judged as showing the greatest improve- 
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ment changed their moral values (in the 
areas of sex, aggression, and authority) in 
the direction of the values of their thera- 
pists, whereas patients who were un- 
improved became less like the therapist in 
values... . 
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49. 
The Control of Eating* 


Charles B. Ferster, 
John I. Nurnberger, and 
Eugene B. Levitt 


Although many investigators have de- 
scribed patterns of eating behavior and 
reported a wide range of factors related to 
obesity (1, 2, 5, 9, 10, 11), specific tech- 
niques for changing an individual’s eating 
behavior are given little or no attention 
in published reports, and programs of 


*From C. B. Ferster, J. I. Numberger, 
and E. B. Levitt, The control of eating, 
J. Mathetics, 1, 87-109 (1962). Reprinted 
by permission of the authors and the 
Journal of Mathetics. 


weight control based on behavioral prin- 
ciples are virtually non-existent. This re- 
port is an account of the application of 
some elementary general principles of 
reinforcement theory (7) to the analysis 
of the behavior of the human eater. This 
theoretical framework of reinforcement 
was used to analyze actual performances 
in eating, and particularly self-control of 
eating. Supplementing the account of this 
system are descriptions of experimentally 
developed techniques which should illus- 
trate practical applications of the theo- 
retical principles of self-control. 

The theoretical analysis begins with the 
simple observation that the act of putting 


1The experiments are still underway 
and will be reported separately by the sec- 
ond and third authors. 


food in one’s mouth is reinforced and 
strongly maintained by its immediate con- 
sequences: the local effects in the gastro- 
intestinal system. But excessive eating re- 
sults in increased body-fat and this is aver- 
sive to the individual. The problem is 
therefore to gain control of the factors 
which determine how often and how 
much one eats. An individual will manip- 
ulate these variables if the control of eat- 
ing is reinforcing to him—if he escapes 
from or avoids the ultimate aversive con- 
sequences of eating (UAC). Unfortu- 
nately for the overeater, the long-term or 
ultimate aversive consequences of obesity 
are so postponed as to be ineffective com- 
pared with the immediate reinforcement 
of food in the mouth, Alcoholism is a 
similar example in which hangover symp- 
toms and the full impact of asocial ac- 
tivity are not suffered until considerable 
time has elapsed. Realization of self-con- 
trol, then, demands an arrangement that 
will bring the influencing conditions into 
closer association with the reduction of 
eating behavior. 

The analysis and development of self- 
control in eating involves four steps: 

l. Determining what variables influ- 
ence eating. Almost every known behav- 
ioral process is relevant to this. Among 
these are control of eating by stimuli, ef- 
fect of food deprivation, chaining, avoid- 
ance and escape, prepotent and competing 
behaviors, conditioned alimentary reflexes, 
and positive reinforcement (2). 

2. Determining how these variables can 
be manipulated. Specification of perform- 
ances within the repertoire by which the 
individual can manipulate these variables. 
One example would be the choice of foods 
which are weak reinforcers, yet rewarding 
enough to maintain the behavior of eating 
them at some low level. 

3. Identifying the unwanted effects 
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(UAC) of overeating. Avoidance of these 
is the basic motive for developing the re- 
quired self-control. 

4, Arranging a method of developing 
required self-control. Some of the required 
performances may call for so drastic a 
change of behavior that it may be neces- 
sary to produce the required repertory in 
stages by reinforcing successive approxi- 
mations. 

Self-control requires for our purposes 
a more precise definition than is conveyed 
by the term “will-power.” It refers to 
some specific performances which will 
lower the disposition to emit the behavior 
to be controlled. These performances in- 
volve the manipulation of conditions in- 
fluencing this behavior. A convenient 
datum for our analysis is the frequency of 
the behavior’s occurrence. The strength, 
durability or persistence of the behavior 
is measured by its frequency. Frequency 
has the measurement advantage of being 
a continuous variable. Similarly, the dis- 
position to eat can vary from small to 
large. The various conditions which the 
individual himself can manipulate to 
lessen the frequency of the controlled be- 
havior will be presented in detail in the 
next section, Avenues of Self-Control. 
The technical problem of generating the 
self-control performance and maintaining 
it in strength will be dealt with in the 
section, Shaping and Maintaining the 
Self-Control Performance. 


Avenues of Self-control 


Tue ULTIMATE AVERSIVE 
CONSEQUENCES 


Avoidance of the ultimate aversive 
consequences (UAC) of uncontrolled 
eating is essential in developing perform- 
ances with which a person may regulate 
his eating behavior. Self-control is needed 
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because of the time lapse between the act 
of eating and its UAC. To overcome this 
time lapse, techniques were sought which 
would derive a conditioned stimulus from 
the UAC and apply it at the time the 
disposition to eat was strong. This is based 
on the principle that almost any event 
may become aversive when paired with a 
known aversive event. Such a conditioned 
stimulus may be the person’s own verbal 
behavior, if specific training procedures 
are applied. It is not enough for the sub- 
ject to know what the aversive effect of 
overeating is, for such knowledge by itself 
leads only to verbal responses weaker than 
the food-maintained behavior and may not 
lessen the strong disposition to eat. There- 
fore an extensive repertoire must be estab- 
lished so that the subject has under his 
control large amounts of verbal behavior 
dealing with the consequences of eating. 
The continued intensive pairing of facts 
about the UAC with various kinds of eat- 
ing performance will make the perform- 
ances themselves conditioned aversive 
stimuli. Once a given performance such as 
eating a piece of pie acquires conditioned 
aversive properties, any approach to it will 
produce aversive stimuli. These stimuli 
will reinforce any self-control because the 
self-control terminates the aversive stimu- 
lus and prevents the un-controlled act. By 
such a process, certain foods like pies, 
cakes, cokes, doughnuts or candy may 
become conditioned aversive stimuli, at 
least until other avenues of control be- 
come available. 

Before the unwelcome consequences of 
overeating can be used in developing self- 
control, they must be identified and de- 
veloped for the individual. It cannot be 
assumed that an obese person already has 
a repertoire about the UAC of eating. In 
the application of the principles to human 
subjects being studied, the development 


of the UAC was one of the major parts of 
the practical program. However, develop- 
ing a repertoire by which the subjects 
could create an aversive state of affairs for 
themselves presents serious technical 
problems. First, to establish this reper- 
toire, the actual aversive events must be 
identified for the subject in terms that 
are meaningful for his daily life. Second, 
the subject must learn an active verbal 
repertoire with which he can translate 
caloric intake into ultimate body fat. 

We first disclosed, in great detail, the 
consequences of uncontrolled eating for 
each individual. After each subject de- 
scribed anecdotes about UAC in group 
sessions, we helped each one to develop 
a fluent verbal repertoire about the rele 
vant aversive consequences. We found 
that simply recognizing the various aver 
sive consequences did not give these sub: 
jects an active verbal repertoire which 
could be invoked immediately and when- 
ever needed. To develop an active reper- 
toire about the UAC, we arranged re- 
hearsals, frequent repetitions, and written 
examinations. In general, the subjects 
were unaware of their inability to verbalize 
the relevant aversive consequences, and 
were surprised by the poor results of the 
early written and oral examinations. Ver- 
bal descriptions of aversive consequences 
the subjects had actually experienced were 
far more compelling than reports of future 
and statistically probable consequences, 
such as diabetes, heart disease, high blood 
pressure, or gall bladder disorder. In other 
words, descriptions of actual or imagined 
social rejection, sarcastic treatment, ex- 
treme personal sensitivity over excess 
weight, demeaning inferences concerning 
professional incompetence or carelessness, 
or critical references to bodily contours or 
proportions were much more potent. All 
of our subjects found their constant and 


unsuccessful preoccupation with dieting 
aversive, and any ability to control their 
own habits highly rewarding. 

All of the exercises in this area were 
designed to develop a strong and vivid 
repertoire that could be introduced 
promptly in a wide variety of situations 
intimately associated with eating and des- 
pite a strong inclination to eat. The actual 
sive effects of being overweight are 
y individual matters which differ 
widely from person to person. We there- 
fore used group discussions as an aid for 
each person to discover how her body 
weight affected her life. The discussion 
was guided toward explicit consequences 
and anecdotes rather than general state- 
ments such as “I want to lose weight be- 
cause I will feel better.” We found that 
after only four or more group sessions, 
subjects shifted from vague statements 
such as “I'll look better in clothes” to 
specific ones such as “My husband made 
a sarcastic remark about an obese woman 
who crossed the street as we were driving 
by.” Perhaps, the verbalization of the 
UAC was too aversive before we had 
demonstrated that self-control was pos- 
sible. 


a 


AMPLIFYING THE AVERSIVE CONSEQUENCES 
OF OVEREATING 


To establish the bad effects of eating 
more than one’s daily requirements, it is 
necessary that the individual know the 
metabolic relationships between different 
kinds of food, general level of activity, and 
gain or loss of weight. Phrases like “Every- 
thing I eat turns to fat” illustrate that the 
required repertoire is frequently absent. 
Thorough training should be given in the 
caloric properties of all of the kinds of 
foods which the individual will encounter. 
The aversive effects of eating certain un- 
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desirable foodstuffs can be amplified by 
generating verbal repertories which de- 
scribe the full consequences of eating 
them. For example, the subject should be 
made to recognize that a 400-calorie piece 
of pie is the caloric equivalent of a large 
baked potato with butter plus a medium- 
size steak. The pie is equivalent to one- 
tenth of a pound of weight gained, and 
so forth. Again, knowing these facts is not 
at issue. The issue is that a strong-enough 
repertoire be established, and with enough 
intraverbal connections, that the UAC 
behavior will occur with a high probability 
in a wide enough variety of situations. 

An important exercise early in the 
weight-control program is the identifica- 
tion of the individual’s actual food intake. 
The subject’s casual summaries of his 
daily food intake are likely to be grossly 
inaccurate. His ability to recognize his 
actual food intake is improved by an inter- 
view technique in which the interviewer 
probes and prompts him: “What did you 
have for breakfast?” “How many pieces of 
toast?” “How many pieces of bread?” 
“What did you do between ten and 
eleven in the morning?” “Were you at a 
snack bar or a restaurant at any point 
during the day?” “Were you offered any 
candy at any point?” and so forth. 

With the pilot subjects, we leaned 
most heavily on a written protocol which 
we used as a basis for individual interviews 
about their diets. Each subject kept a 
complete written account of everything 
she had eaten, along with calculations of 
fat, carbohydrate, protein, and numbers of 
calories. A large part of the early sessions 
was devoted to problems in recording food 
intake, such as difficulties in estimating 
mixed foods like gravies, stews, or sauces. 

For the first four weeks of the program, 
when some simpler kinds of self-control 
were developed, the subjects’ caloric in- 
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take was set to maintain a constant 
weight. We over-estimated the mainte- 
nance levels, and all subjects gained 
weight during this month. However, the 
weight increase proved the relationship 
between caloric intake and weight change 
in a situation where the caloric intake was 
carefully defined. In spite of the weight 
gain, however, some measure of self-con- 
trol emerged, particularly in changes in 
the temporal pattern and regularity of 
eating. 


Deprivation 


The effect of food deprivation may be 
observed in a pigeon experiment in which 
the frequency of a pigeon’s key pecking, 
maintained by producing food, is meas- 
ured as a function of changes in the level 
of food deprivation. Changes in the level 
of food deprivation produce continuous 
changes in the bird’s performance over an 
extremely wide range if we can measure 
the frequency of the bird’s pecking. This 
frequency of pecking is intuitively close 
to notions like the bird’s disposition to 
eat, probability of action, or motivation. 
When a wide range of frequency response 
can be measured sensitively, the level of 
deprivation affects the bird’s performance 
continuously, from  free-feeding body 
weight to as low as 65 or 70 per cent of 
normal body weight. Food deprivation of 
the order of six to twenty-four hours con- 
stitutes a very small part of the effective 
range. The magnitude of food deprivation 
therefore continues to increase the organ- 
ism’s disposition to emit responses, rein- 
forced by food, long after no further 
changes occur in gastrointestinal reactions 
(e.g, hunger pangs) and other condi- 
tioned effects of food in the mouth. The 
hunger pangs, which are ordinarily taken 
as symptoms of hunger (from which the 


effect of food deprivation is inferred), are 
more closely related to the conditioned 
stimuli accompanying past reinforcements 
of eating than to the level of food dep- 
tivation. The conditioned reflexes involy- 
ing the gastrointestinal system occur at 
relatively low levels of deprivation com- 
pared with the effective range of food 
deprivation in respect to the changes in 
frequency of operant behavior. There may 
be a similar lack of correspondence be- 
tween the tendency to verbalize, intro- 
spectively, reports of hunger and the ac- 
tual disposition to eat. For purposes of 
developing self-control, the actual per- 
formances resulting in food in the mouth 
are more relevant than the introspective 
reports of “hunger.” 

Controlling the rate at which the sub- 
ject loses weight proves to be a major 
technique of self-control. For any degree 
of establishment of a self-control reper- 
toire, there is probably some level of food 
deprivation which will cause the subject 
to eat in spite of the self-control behavior. 
Therefore, a major principle of self-control 
would be to pace the rate of the subject’s 
weight loss so that the effect of the weight 
loss on the disposition to eat would be 
less than the given stage of development 
of self-control. Many avenues of self-con- 
trol may be learned without causing any 
weight loss. Placing the eating behavior 
under the control of specific stimuli or 
breaking up the chain of responses usually 
present in the compulsive eater are ex- 
amples of this. The former will be dis- 
cussed below. Breaking up a chain causes 
the eating performances to become a 
series of discrete acts which are more 
easily interrupted than a continuous per- 
formance in which each chewing response 
or each swallow occasions placing the 
next bit of food on the fork. 

If the self-control performances which 


may be developed are to be useful, they 
must be maintained by conditions which 
will be present continuously, even after 
the weight-control therapy procedures are 
discontinued. Many unsuccessful crash 
diet programs illustrate the way in which 
too rapid a loss of weight produces a level 
of deprivation and a disposition to eat 
exceeding the existing self-control. The 
usual diet involves some program which 
taps the motivation of the dieter tempo- 
rarily. For example, slight aversive pres- 
sure from the husband or family doctor 
may produce a rapid loss in weight, per- 
haps on the order of three to five pounds 
a week. The effect of the rapid weight 
loss is a large increase in the disposition to 
eat which then overcomes the subject’s 
temporary motive. 

Limiting the diet to one specific food, 
such as protein, probably will produce a 
heightened disposition to eat other food- 
stuffs regardless of the general weight 
level. These are the traditional specific 
hungers. An all-protein diet, for example, 
even if taken without limit of calories, 
would probably generate an enormous 
disposition to eat carbohydrates, sugars, 
and fats. Therefore, a balanced diet should 
be maintained and a weight loss brought 
about by a uniform reduction in amount 
rather than kind of food. 

Although the major effects of food 
deprivation appear when weight losses are 
of the order of pounds, the time elapsed 
since eating would have local effects on 
the disposition to eat. Local satiation ef- 
fects may best be used as a limited avenue 
of self-control by arranging the eating 
schedules so that the subject ingests a 
meal or a significant amount of food just 
before a situation in which the disposition 
to eat might be unusually strong. An ex- 
ample is a social situation in which eating 
has frequently occurred in the past or 
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when preferred foods are present. ‘The 
housewife who eats continuously while 
preparing dinner can control the disposi- 
tion to nibble the foods being prepared 
by shifting the preparation of the dinner 
meal to the period of time immediately 
following lunch, when her disposition to 
eat is lower because she has just eaten. 

In the application of the self-control 
principles to actual exercises, we specified 
a weight loss of one pound per week and 
insisted that our subjects adhere to this 
rate of weight loss even though each of 
them wanted to cut her diet more strin- 
gently in order to lose weight at a greater 
rate, Different rates of weight loss might 
possibly be arranged at different stages of 
development of self-control after more is 
known about the effectiveness of different 
avenues of self-control and about the rela- 
tive effects of weight loss depending upon 
the initial level. 

The continued ingestion of food during 
a meal provided another variation in level 
of food deprivation which was used to 
provide a gradual transition to the final 
self-control performances. Exercises, such 
as brief interruptions in eating were first 
carried out toward the end of the meal 
when some satiation had occurred. After 
the subjects began to learn how to use 
auxiliary techniques to stop eating and 
their existing eating patterns began to 
break down, the exercises were moved 
progressively toward the early part of the 
meal, when their levels of deprivation 
were higher so that the exercises had to be 


more difficult. 


SELF-CONTROL BY MANIPULATING 
STIMULI 


The characteristic circumstances when 
an individual eats will subsequently con- 
trol his disposition to eat. The process 1s 
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illustrated by the pigeon whose key peck- 
ing produces food only when the key is 
green and not when it is red. The fre- 
quency with which the pigeon pecks the 
key (reinforced by food) will later depend 
upon which color is present. Thus, chang- 
ing the color of the key can arbitrarily 
increase or decrease the frequency of peck- 
ing independently of the level of food 
deprivation. A frequent factor in the 
lack of self-control in the obese person 
may be the large variety of circumstances 
in which eating occurs. In contrast, a 
much narrower range of stimuli is present 
during the more infrequent eating periods 
of the controlled person. Therefore, the 
disposition to eat possibly could be de- 
creased by narrowing the range of stimuli 
which are the occasions for the reinforce- 
ment by food. By proper choice of the 
actual stimuli controlling the eating be- 
havior, it should also be possible to in- 
crease the individual’s control over these 
stimuli. There are circumstances when 
even the pathologically compulsive eater 
will have a considerably lower disposition 
to eat for periods of time simply because 
the environment is novel enough so that 
eating has never occurred then. Consider, 
for example, walking in an isolated forest 
area, 

The first step in the development of 
self-control in this category is to narrow 
the range of existing stimuli which control 
eating. The overweight individual eats 
under a large variety of circumstances. 
Thus, the problem of self-control is made 
difficult by the large number of daily 
occasions which bring the tendency to eat 
to maximal levels because in the past they 
have been the occasions when eating has 
occurred. Two kinds of behavior need to 
be brought under stimulus control. The 
first is the elicited reflex effects of food, 
such as salivation, gastric secretion, and 


other responses of the gastrointestinal 
tract. The other involves operant behav- 
ior, or the behavior involving the striated 
musculature of the organism—walking, 
talking, reaching, cooking, and so forth. In 
the so-called voluntary behaviors, the 
major datum is the frequency of the be- 
havior rather than the magnitude of an 
elicited reflex, as with the smooth-muscle 
response of the digestive system. Although 
these two types of behavioral control are 
inevitably tied together, their properties 
are different and they must be distin- 
guished both dynamically and static: 
In order to break down the control 
ing by the stimuli which have be 
characteristic occasions on which eating 
has been reinforced in the past, the 
stimuli must occur without the subse- 
quent reinforcement by the food. The 
process is a direct extrapolation from the 
extinction of a Pavlovian conditioned re- 
sponse. If the dog is to discontinue saliva- 
tion on the occasion of the bell, the bell 
must be presented repeatedly in the situa- 
tion in which the food no longer follows. 
The amount of saliva the bell elicits then 
declines continuously until it reaches 
near-zero. Similarly, the stimuli character- 
istic of the preparation of a meal will 
cease to control large amounts of gastric 
activity if these stimuli can be made to 
occur without being followed by food in 
the mouth. Initially, the stimuli will elicit 
large amounts of gastric activity; but with 
continued exposure to these stimuli, the 
amount of activity will decline continu- 
ously until low levels are reached. 
Delimiting existing stimulus control of 
eating may take considerable time because 
(1) the loss of control by a stimulus is a 
gradual process, requiring repeated expo- 
sure to the relevant stimuli; and (2) it 
may be a long time before the individual 
encounters all of the situations in which 


he has eaten in the past. The sudden 
temptation of the ex-smoker to light a 
cigarette when he meets an old friend is 
an example of the latter kind of control. 

Self-control developed under procedures 
involving very special situations and foods 
(for example, liquid diets, all-protein 
diets, or hard-boiled eggs and celery) will 
be difficult to maintain when the diet 
circumstances return to normal. The very 
abrupt shift in eating patterns, kinds of 
food eaten, and characteristic circum- 
stances surrounding eating will weaken 
the self-control performances as well as 
strengthen eating behaviors which were 
previously in the person’s repertoire under 
the control of the more normal environ- 
ment. Hence, self-control performances 
must be developed under circumstances 
and with foods which are to be the in- 
dividual’s final eating pattern. 


TEMPORAL CONTROL OF EATING 


The time of day is an important event 
controlling eating. With the individual 
who characteristically eats at regular inter- 
vals, gastric activity comes to precede 
these occasions very closely, and is at low 
levels elsewhere regardless of levels of 
deprivation. The same can be said for 
operant behavior associated with eating, 
although the order of magnitude of some 
of the parameters may be different. After 
the conditioned responses associated with 
eating are brought closely under the con- 
trol of a strict temporal pattern, feelings 
of hunger should disappear except just 
before meal-time. However, many individ- 
uals have no such routine patterns of eat- 
ing, so that the temporal pattern of eating 
does not limit the amount of gastro- 
intestinal activity. The obese person fre- 
quently eats in the absence of any gastric 
activity. A technique of self-control in this 
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category would rigidily specify a temporal 
pattern of eating and find conditions for 
adhering to it. As with the gastrointestinal 
reflexes, this general disposition to engage 
in operant behaviors reinforced by the in- 
gestion of food can be brought under the 
control of a temporal pattern of eating, 
with a resulting lower disposition to eat 
during the intervals between regular meals. 
In the early stages of learning self-control, 
the development of a rigid temporal pat- 
tern perhaps should be carried out under 
conditions in which no weight loss is to be 
expected and the amount of food, in- 
gested at specified meals, is large enough 
to minimize the disposition to eat on 
other occasions. The subsequent mainte- 
nance of this temporal pattern of eating 
when the subject begins to lose weight 
will depend upon the concurrent action of 
other categories of self-control perform- 
ances. The control of eating by temporal 
factors can also be developed for situa- 
tions other than the normal routine meals 
as for example, at social gatherings and 
parties. Because the availability of food is 
predictable here, early stages of self-con- 
trol can include arranging a specific time 
when the eating will occur rather than 
indeterminate consumption of whatever 
foods happen to be available. 


Tue EATING SITUATION 


As with the temporal properties of eat- 
ing, the actual characteristics of the eating 
situation may be used to control the dis- 
position to eat. However, the stimuli here 
are clearer and probably exert control of 
an even larger order of magnitude than 
that of the temporal pattern. This appli- 
cation of the principle of stimulus control 
is the same as in the temporal contin- 
gency: to arrange that eating occur on 
limited and narrowly circumscribed occa- 
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sions and never otherwise. To simplify the 
development of the stimulus control, eat- 
ing situations should be associated with 
stimuli which occur infrequently in the 
individual’s normal activities. For exam- 
ple, an eating place in the home should 
be chosen so that it is maximally removed 
from the routine activities of the day. Nor 
should eating occur together with any 
other kind of activity such as reading. If 
reading occurs frequently enough while 
the subject is eating, then reading will 
increase the disposition to eat because it 
has been an occasion on which eating has 
been reinforced. 


EMPHASIZING THE STIMULUS CONTROL 


The occasions characterizing eating can 
be emphasized by deliberately arranging 
very obvious stimuli. For example, the 
subject always eats sitting down at a table 
which has a napkin, a place setting, and a 
purple table cloth. The latter makes the 
situation even more distinctive. In the 
extreme case, a specific item of clothing 
might be worn whenever the subject eats. 
Narrowing the range provides another 
form of stimulus control. By eating only 
specific foods in specific places, the dis- 
position to eat when other foods are avail- 
able will be minimized. This factor will 
also be discussed under chaining; but the 
aspect emphasized here is the effect of the 
foods eaten as one of the elements in the 
occasion associated with eating. If a sub- 
ject has eliminated ice cream, candy, and 
cake from his diet, the sweet shop will 
have little control over his behavior. 

In the actual procedures with subjects, 
stimulus control was the first avenue of 
self-control developed. The subjects 
learned to keep daily diet protocols during 
the first few meetings and to determine 
the number of calories necessary to main- 


tain their weight. We restricted eating to 
three meals a day, eliminated concen- 
trated fats and sugars from the diet, and 
attempted to bring about an increase in 
the amount of food taken in at meals, 
particularly at breakfast, to bring about 
a normal pattern of eating without any 
expected weight loss. For individuals hav- 
ing difficulty in restricting their eating to 
meals, we arranged a specific and routine 
extra feeding, as, for example, a glass of 
milk and a few crackers at bedtime. The 
extra feeding was to be taken routinely, 
however, so it did not become a reinforcer 
for increasing the probability of eating on 
a wide variety of occasions. No weight loss 
was attempted until the subjects were 
successful in eating a normal range of 
food at meals without any eating at other 
times. We attempted to create an eating 
pattern which could be carried out with- 
out interruption after the weight-control 
program was terminated. Our major prob- 
lems were insufficient protein or excess 
fat in the diet. None of the subjects ate 
excessive amounts of carbohydrate except 
perhaps as candy. However, all subjects 
had trouble eating a full meal. It was 
paradoxical that women who joined the 
program because they could not limit 
their eating had difficulty in ingesting a 
maintenance diet at mealtimes. One com- 
plained of nausea, another of chest pains, 
and a third of discomfort from overeating. 
All of the complaints disappeared in a 
week, however. 


CHAINING 


Eating is a rough designation for a chain 
of behavioral sequences culminating in 
swallowing and the subsequent gastroin- 
testinal reflexes. An illustrative sequence 
might be as follows: Dressing makes pos- 
sible leaving the house; leaving the house 


leads to walking to the store; entering 
the store is followed by the selection of 
foods; a basket of food is the occasion for 
paying the clerk and leaving the store; a 
bag of groceries at home leads to storing 
the food; stored food is the occasion for 
cooking or otherwise preparing the food; 
the prepared food is the occasion for 
setting the table and sitting down; the 
sight of food is the occasion for cutting it 
with a fork or knife; the dissected food 
leads to placing food in the mouth; food 
in the mouth is followed by chewing; and 
chewing is followed by swallowing. The 
sequence differs from individual to indi- 
vidual and from time to time, but any 
selected elements illustrate the process. 
Because the frequency of occurrence of 
the final member of the chain depends 
on the nature of the earlier members of 
the eating sequence, some degree of self- 
control can be arranged by dealing with 
the dynamic properties of the eating se- 
quence. The length of the chain of re- 
sponses leading to swallowing will mark- 
edly influence the frequency with which 
the eating sequence is carried out. The 
longer the sequence of behaviors in the 
chain and the more behavior sequences in 
each member of the chain, the weaker will 
be the disposition to start the chain. This 
property of chaining suggests a technique 
of control which could be useful if used 
in conjunction with the other avenues of 
control. By arranging that all of the foods 
available or accessible require a certain 
amount of preparation or locomotion, the 
tendency to eat can be reduced simply be- 
cause the chain of responses leading to 
swallowing was lengthened. Keeping food 
out of areas normally entered, shopping 
on a day-to-day basis (at a time when the 
disposition to eat is low), buying foods 
which are not edible without cooking or 
other preparation, and placing food in less 
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accessible places are some techniques for 
weakening the disposition to eat by 
lengthening a chain. As in some of the 
avenues of control, this technique would 
be inadequate under extreme levels of 
deprivation without additional support 
from other types of control. The chain 
must not be lengthened too much, or it 
might become so weakened that prepo- 
tent eating behaviors would occur or the 
chain shortcircuited. 

The actual form of the eating chain in 
the latter members just before swallowing 
may be rearranged to reduce the rate of 
eating. The behavior of swallowing is so 
strongly reinforced that it could occur 
very soon after food enters the mouth, 
without very much chewing. Similarly, the 
behavior of placing food in the mouth 
(reinforced by the taste of food) has high 
strength and occurs as soon as the mouth 
empties. Many eaters carry out this se- 
quence at a very high rate by reaching for 
additional food just as soon as food is 
placed in the mouth and by swallowing 
while the fork is in transit to the mouth. 
This analysis is confirmed by the high 
rate with which many obese people eat 
compared with that of non-obese eaters. 

To reduce the rate of eating and to 
make it possible for the subject to stop 
eating at any point, we designed simple 
exercises to break the chain, particularly 
the near-final members, so that the occa- 
sion for placing food on the fork is swal- 
lowing rather than chewing. The new 
sequence was: food on the fork only after 
other food is swallowed and the mouth is 
empty. These exercises depended on ancil- 
lary techniques of control already de- 
veloped by other techniques of self-con- 
trol. At the start, the interruptions were 
only a few seconds, then they were grad- 
ually increased to several minutes. The 
ability to stop eating at any point repre- 
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sents the final effect of nearly all of the 
other avenues of control; nevertheless, it 
constitutes a separate technique of con- 
trol demanding special exercises. In later, 
more difficult exercises, the subject holds 
food on a fork for various periods of time 
without eating. Similarly, chewing is pro- 
longed before swallowing for increasing 
periods. These exercises are carried out 
initially at the end of a meal, when the 
deprivation level is low. 

The type of food eaten is of major im- 
portance in how reinforcing it would be, 
and hence how long a chain of responses 
can be maintained by the food reinforce- 
ment. The disposition to eat could be 
somewhat regulated by a selection of 
foods in the individual’s diet that are 
sufficiently reinforcing (appetizing, ca- 
loric, etc.) to be eaten, but minimally 
reinforcing so as to minimize the resulting 
disposition to eat. A certain balance must 
be achieved; if the foods chosen are so 
unappetizing or unappealing that their 
reinforcing effect is negligible, the subject 
will simply switch to other foods. Also 
relevant here are the dynamic effects of 
food deprivation. Foods which are maxi- 
mally reinforcing should be eaten when 
the individual is less deprived, and mini- 
mally reinforcing foods should be eaten 
under stronger conditions of deprivation. 
In other words, the effect of the highly 
reinforcing foodstuffs on the disposition 
to eat would be minimized by a lower 
level of deprivation so that the subject can 
stop eating more easily. In special cases, 
the food intake could be increased tem- 
porarily in order to minimize the highly 
reinforcing effect of certain foods. For 
example, if an individual who is highly 
reinforced by caloric pastries knows she 
will be in a situation where such pastries 


probability of eating them by increasing 
her food intake during the preceding 
meal or by a glass of milk before entering 
the situation. 


PREPOTENT REPERTOIRES 


One way to lessen the disposition to eat 
is to supplant it by establishing other 
activities incompatible with eating. In an 
extreme case, an apparently large disposi- 
tion to eat is often due to a behavioral 
repertoire in which eating appears strong 
because the rest of the repertoire is weak. 
Some degree of self-control should be 
possible if some activity could be main- 
tained at a potentially high strength and 
circumstances arranged so that the sub- 
ject could engage in this activity whenever 
the disposition to eat was strong. An 
example of such an activity might be tele- 
phoning a friend just after breakfast in- 
stead of indulging in the customary be- 
tween-meal nibbling. The use of prepotent 
repertoires as a technique of control im- 
plies a certain amount of control over the 
prepotent repertoire. In order for these 
substitutive repertoires to be effective, 
special attention must be given to meth- 
ods for strengthening them, particularly 
when they are needed. For example, in- 
stead of reading the newspaper as soon as 
it arrives, it could be put aside until some 
time when the peak tendency to eat oc- 
curs. Similarly, the telephoning of friends 
could be postponed in order to keep this 
behavior at high strength. Such activities 
occur initially because of independent re- 
inforcement. Another kind of prepotent 
repertoire may be established by starting 
some strongly reinforced activity whose 
reinforcement occurs only if the behavior 
occurs uninterrupted for a period of time. 


are being served, she could lessen the- Examples are washing a floor, going to a 


movie, taking a bus ride, reading a short 
story, or going for a walk. Such perform- 
ances will be prepotent over eating because 
of the temporary aversive consequences re- 
sulting from their interruption. In many 
cases, the prepotent repertoires physically 
remove the individual from the place 
where eating can occur. 

The effective use of prepotent reper- 
toires depends upon the development of 
other avenues of control. Probably no one 
of these “prepotent” performances would 
be effective by itself if the disposition to 
eat were strong. For example, the individ- 
ual going for a walk could simply stop at 
a restaurant to eat, Nevertheless, there is 
still a net advantage, because the supple- 
mentary types of self-control needed are 
relatively easy. For example, compare the 
disposition to stop at a restaurant during 
a walk with the disposition to eat in the 
normal situations when eating usually oc- 
curs, If the individual usually eats at 
home, the tendency to stop at a restaurant 
and eat will be considerably less than the 
tendency to eat at home. No explicit 
training was required in the pilot experi- 
ment to establish self-control by the use 
of prepotent repertoires; but all of the 
subjects used them during several phases 
of the experiment. 

Prepotent repertoires may be affected 
by emotional factors. For example, many 
persons eat when depressed, affronted, 
thwarted, or frustrated. In the terms of 
the functional analysis of eating used 
here, emotional factors may weaken be- 
haviors other than eating so that eating 
becomes relatively stronger. Putting food 
in one’s mouth remains a highly reinforc- 
ing activity even if the remainder of the 
individual’s repertoire is severely de- 
pressed. Eating then occurs because it is 
less disrupted by the emotional variables 
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depressing the rest of the individual's 
repertoire. 

Eating may interact with emotional fac- 
tors in more subtle, but nonetheless im- 
portant, ways, as a mechanism by which 
a person might escape or avoid emitting 
verbal behavior which is highly aversive, 
e.g, thinking about impending circum- 
stances which are highly aversive. Because 
of its very strong and immediate reinforce- 
ment, eating will be prepotent over think- 
ing about anxiety-evoking occurrences. 
Thus, eating comes to acquire two sources 
of strength: The immediate reinforce- 
ment from food in the mouth, and the 
reinforcement from postponing or avoid- 
ing the aversive consequences of emitting 
the verbal behavior which the eating sup- 
plants. Emotional disturbances will also 
disrupt the performances by which the 
individual controls himself, as will any 
general depression or disturbance of the 
individual's over-all repertoire. Self-control 
performances will be especially liable to 
disruption early in their development, be- 
fore they become strong and maintained. 

The manipulation of factors to mini- 
mize the effects of emotional disturbances 
is a separate topic, involving self-control 
of variables different from those in eating 
and thus requiring a separate analysis. The 
main avenue of control in eating lies in 
increasing the strength and durability of 
the self-control performances so that they 
will remain intact during emotional dis- 
turbances. For example, a person who has 
acquired an active and extensive verbal 
repertoire about all of the personal aver- 
sive consequences of being overweight will 
be able to emit these behaviors even dur- 
ing some general depression of his behav- 
ioral repertoire. The behavior about the 
ultimate aversive consequences of eating 
will be even more durable during possibly 
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disrupting situations if it has already been 
effective in producing self-control, that is, 
if the behavior about the UAC has been 
reinforced effectively by suppression of 
the disposition to eat. 

If existing levels of self-control are cer- 
tain to break down because of an emo- 
tional disturbance, the individual should 
be trained to plan a controlled increase in 
food intake. The advantage of explicitly 
increasing the level of food intake would 
be that the food would be eaten under 
controlled conditions, so that stimulus 
control and other factors of self-control 
already developed would be maintained, 
and the effects of absence of progress in 
self-control would be minimized. Over- 
eating under planned conditions would 
probably weaken the already developed 
self-control repertoires less than un- 
planned or uncontrolled eating. 

In many situations, the general depres- 
sion of an individual’s repertoire occurs 
only for a limited time. Here, the neces- 
sary self-control performances would be a 
manipulation of the physical environment 
so that food is not available then, or 
would be the creation of a prepotent en- 
vironment. The depressed individual who 
wishes to control his eating goes to a 
movie, takes a ride on a bus, or goes for 
a long walk. These activities give time for 
the emotional states to disappear and 
simultaneously provide an environment in 
which eating has not been reinforced very 
frequently in the individual’s past experi- 
ence. Of course, applications of these 
techniques of control depend upon the 
prior achievement of a certain amount of 
self-control, and probably are some of 
the most difficult areas of self-control to 
acquire. Such items would not be at- 
tempted at an early stage of the self- 
contro] program. . . . 


DISCUSSION 


. . . Most of the present report is a 
presentation of certain practical tech- 
niques which can be applied to the prob- 
lem of uncontrolled eating. The prelimi- 
nary results of this pilot program are not 
included as a record of even mediocre 
success, but rather as a description of the 
medium within which the specific tech- 
niques of control were imparted. A much 
longer follow-up period and a larger num- 
ber of cases are necessary to develop a 
successful program as well as test it. Nor 
can we now designate these aspects of 
the program which were effective or in- 
effective. This report is intended to pro- 
vide a theoretical and practical model for 
more structured programs of self-control 
in eating. We have shown eating habits 
can be changed in a short-term, small- 
group-therapy program by the use of the 
basic principles outlined here. Whether 
or not the weight losses reported during 
the first 15 sessions are primarily due to 
the application of the principles outlined 
can be determined only by appropriately 
controlled study experiments. We are not 
concerned whether one or another pro- 
gram can effect weight loss, since many 
pharmacologic individual- and group- 
therapy programs lead to temporary loss 
of weight, as is generally known. The 
central issue is the development of self- 
control in eating which will endure and 
become an available part of the individ- 
ual’s future repertoire. Most conventional 
programs do not focus on the eating pat- 
terns available to the subject after he has 
lost weight, nor do they present recog- 
nizable techniques for developing such 
future control. Possible exceptions are in 
individual programs of psychotherapy 


which are directed toward an exploration 
and resolution of the unconscious de- 
terminants of eating behavior, and in 
certain of the conditioned-reflex tech- 
niques. Yet, even in these programs, this 
question remains: Do proper eating hab- 
its exist after the individual is free of the 
relevant disability? The program outlined 
here has the special advantage of focusing 
directly and specifically on future eating 
behavior and of presenting even more 
specific techniques for bringing this be- 
havior under control. Application of the 
basic principles requires no special instru- 
mental or technical training and is rela- 
tively economical. Slow and controlled 
weight loss under relatively high-caloric 
intake levels minimizes medical and psy- 
chological problems. 

We cannot state whether the program 
we carried out is suitable for severely obese 
individuals (particularly those who have 
medical or psychiatric complications). Nor 
can we specify how the technical princi- 
ples and procedures can be applied to sub- 
jects of low educational level or of limited 
intelligence, A major problem here would 
undoubtedly be the difficulty of daily and 
accurate caloric-intake records. Some of 
these fundamental questions are subjects 
for future study. 
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Fading, principle of, 106-109 

Fan item analysis, 420 

Friedman nonparametric analysis of variance, 
95, 97 


G 


Galvanic skin response (GSR), verbal re- 
sponse and, 164-171, 208 


Garceau Clinical Dermohmeter, 164 n., 
166, 167 
Generalization, 154, 157-162 
brightness stimuli and, 164-171 
galvanic skin response and, 164-171 
mediated, 154, 157-158, 301, 307-315 
and problem solving, 238-240 
mediated verbal, 154, 164-171 
nonmediated, 154, 157 
semantic, 154-157, 160, 171 
stimulus, 69, 73 
Gerbrands Cumulative Recorder, 28, 38 
Gerbrands Universal Feeder, 27, 126, 128 
Gestalt psychology, 300 
Gifted children, 11, 12 
Gradual progression, principle of, 106 
Guilford-Zimmerman traits, 417, 419-420, 
422 


H 


Habit family hierarchy, 233-242, 256 
compound temporal, 233-234, 236-240 
extinction and, 235-236 
reinforcement and, 235-236 
spatial, 233-234 

Homosexuality, treatment of, 476 

Human engineering, 102 


I 


Identification, 372-383 
definition of, 372 
envy theory of, 373 
reward and, 380-383 
secondary reinforcement theory of, 374 
sex-role behavior and, 382-383 
social power theory of, 373-374 
Imitation, see Identification 
Intelligence quotient (IQ), effect of cogni- 
tive learning on, 9-12, 14-15 
environment versus heredity in, 10-12 
Introspection, 390 


J 


James-Lange-type theory of problem solving, 
255 n. 
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K 


Kent-Rosanoff association test, 198-200, 276 

Knowledge, habit mechanisms and, 148- 
152 

Kruskal-Wallis analysis of variance, 49, 97 


L 


Language, cognitive learning of, 8-9 
as conditioned behavior, 154-162 
as conditioning stimulus, 180-185 
as medium of communication, 177-178, 
191 
see also Verbal behavior 
Learning, attitudes and, 299-300 
avoidance, 407-408 
cognitive, 7-18 
by identification, 372-383 
imitative, 6, 45-50, 482 
principles of, 2-3 
applied to human behavior problems, 
121-143 
trial and error, 234, 236, 239 
versus nature, 4, 16 


M 


Mand, 337 
use of, by autistic children, 427—428 
Mann-Whitney U Test, 50, 87, 402 
Mann-Whitney unpaired replicates test, 97 
Mathetics, 115-120 
Mediated generalization, 154, 157-158, 301 
attitude formation and, 307-315 
color preference and, 311-315 
Mediation hypothesis, 154, 157, 164-171, 
172-175, 184 
attitudes and, 301 
effect on paired associate learning of, 


197-204 
S-R model for problem solving and, 247- 
250 


salivary response and, 187 
sensory response and, 186-187 
Mental apparatus, Freud’s theory of, 388- 
394 
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Minnesota Kent-Rosanoff Word Association 
Norms, 276 
Monents, 278, 284-289 
covert, 287-289 
Motivation, behavior and, 6 
of retarded children, 36 
Motor skills, development of, 7-8 
Munsell colors, 165, 171 


N 


Notants, 278 
Nondeprivation, as control condition, 53- 


Notates, 278, 285-286 


(0) 


Obsessions, treatment of, 476 
Operant conditioning, awareness and, 278- 
281 
and cooperation, 354-358 
of personality traits, 416-424 
principles of, 138 
for reading, 67-68, 125-127 
in treatment of psychotics, 466-471, 479 
of verbal structures, 219-228 
Operant learning, 68 
communication and, 191-196 
Operant-discrimination technique, 42-44, 
205-206 
Originality, compared with creativity, 259- 
260 
methods for training, 259-262, 264-271 
interpretation of, 269-271 
learning to learn and, 268-269 
reinforcement and, 269-270 
and productive thinking, 263 
test of, 261 


B 


Patterning, definition of, 180 n. 

Perception, attitudes and, 299-300 
Permissiveness, 477—478 

Personality, learning approach to, 385-387 


Prepotent repertoire, use of, in control of 
eating, 496-498 
Problem solving, 231-233 
approaches to, 243-244 
conditioning and, 234, 236, 239 
habit family hierarchy and, 233-24 
horizontal and vertical processes for, 245- 
257 
mediated generalization and, 238-240 
S-R theoretical model for, 244-257 
verbal behavior and, 252-254 
Psychoanalysis, concepts and theories of, 
387-394 
Psychotherapy, 473-483 
Psychotics, reinforcement stimuli and, 137- 
138, 449-452 
treatment of, 137-138, 445-457, 
452 
verbal behavior of, 466-471 
Punishment, influence on social behavior of, 
347-353, 480-481 
Purpose, verbal mechanisms in, 214, 218-228 


449- 


R 


Reaction times, 408-411 
Reading, acquisition of, 74-75 
compared with speech development, 
74-77, 122 
suggested research in, 78-80 
cognitive learning and, 12-15 
intensive training in, 76-77 
operant conditioning and, 67, 125 
remedial, 139 
use of reinforcement in, 122-137 
Recall, verbal reinforcement and, 398-403 
Reconditioning, effect on speech of, 95-100 
Reinforcement, 68, 70-71 
authority and, 342-344 
autistic children and, 137-138, 428-443 
competition and, 361-365 
conditioned, 115-120, 205-212 
cooperation and, 354-358, 359-365 
deprivation and, 51-62 
developmentally retarded children and, 
26 ff. 
effect on recall of, 398-403 


Reinforcement (Cont.) 
effect on speech conditioning of, 92, 98- 
100 
generalized, 396, 435-437 
in habit family hierarchy, 235-236 
identification and, 374 
infant vocalization and, 83, 88, 137 
influence on social behavior of, 347-353 
intermittent, 431-433 
multiple scheduled, 33-34, 134-136 
originality training and, 269-270 
in physical rehabilitation, 138-139 
in reading acquisition, 77-78, 122-137 
satiation and, 51-62 
in teaching machines, 102 
thumbsucking and, 37-41 
in treatment of psychotics, 137-138, 
479-480 
variable interval, 132-133 
variable ratio, 132-133 
vicarious, 45-50 
Releasor-organizer hypothesis, 181 n. 
Repression, avoidance conditioning and, 
404-415 
Retarded children, developmentally, mo- 
tivation of, 36 
reinforcement in, 26-36, 134-136 
Reward, identification and, 380-383 
and positive attitudes, 361, 368-371 
in psychotherapy, 478-480 


Satiation, 127 
definition of, 52 
drive and, 51-62 
Schizophrenia, autism as form of, 425-426 
reward in treating, 478-479 
use of food to control behavior in, 458- 
465 
verbal behavior in, 395-397 
see also Psychotics 
Scientific method, 388 
Freud’s theories and, 387—389 
Self-control, in eating, 486-489 
by manipulating stimuli, 491-493 
Semantic differential, 209-210 
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Semantic gradient, 154 

Semiotics, 154 

Set, verbal mechanisms in, 214-228 
defined, 219 

Sex-role behavior, identification and, 382- 


Sibling rivalry, 391-392 
Smith-Williams vocabulary test, 9 
Social behavior, 347—353 
punishment and, 349-351 
reinforcement and, 349-351 
Social conditioning, 82-90 
Social imitation, 481-482 
Social interaction, 329-336 
attitudes and, 366-371 
authority and, 337-345 
cooperation and, 354-358 
Social psychology, attitudes and, 295-296 
conditioned reinforcers and, 212 
Sociology, attitudes and, 295-296 
Speech, development of, 69-73 
compared with reading acquisition, 75- 
77 
reinforcement in, 70-71, 92, 98-100 
related to infant vocalization, 88-89 
operant conditioning of, 69-70, 90-100 
opposite, 395-397 
use of extinction in, 95-100 
use of reconditioning in, 95-100 
Stanford IQ scores, 11, 13, 14 
Stanford-Binet IQ scores, 53 
Stimulus, conditioned, 205-212 
control of, in autistic children, 437 
discriminative, authority and, 340-342 
principle of, 69, 72-73, 191, 469 
nonverbal, 192-196 
satiation, 455-456 
Stimulus, generalization principle, 69, 73 
S-R theoretical model for problem solving, 
244-257 
chaining and, 245, 255 
mediation hypothesis and, 247-250 
mediational versus single unit theory of, 
248-251 
Stimulus similarity, 157-158 
Stuttering, treatment of, 139 
Successive approximation principle, 68-69, 
71-72 
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Tact, in speech development, 73, 191, 284, 
428 
Tantrums, 472-473 
Teaching machines, 101-114 
advantages of, 102-103 
modifications of, to fit students, 111-113 
past failures of, 101-102 
Testing, technology of, 102 
Tests, see specific test names 
Textual responses, 74, 122, 192 
see also Reading 
Thinking, productive, 239, 263 
versus reproductive, 239-241, 263 
Thumbsucking, 5 
reinforcement and, 37-41 
withdrawal technique and, 37—41 
Tics, treatment of, 477 
Traits, personality, effect of reinforcement 
on, 417-424 
interpretations of, 422-423 
operant conditioning of, 416-424 


U 
Ultimate aversive consequences (UAC), in 


eating, 487. 
Unusual Uses Test, 265-267, 270 


v 


Verbal behavior, avoidance conditioning of, 
404-415 
definition of, 395 
importance of, 64 
and problem solving, 252-254 
in psychotherapy, 424 
restoration of, in psychotics, 466-471 
reward of, causing change in attitude, 
316-321 
schizophrenia and, 395-397 
see also Speech 
Verbal habit family, 221 
Verbal mechanisms, 214—228 
Verbal operants, 278-279 
Verbal psychotherapy, 212 
Verbal response, GSR and, 164-171 
Vocalizations, in the infant, 82-89, 137 
related to speech development, 88-89 


w 


Withdrawal, thumbsucking and, 37—41 
Word association, 167-179 
effect of punishment on, 404-406 
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